Integrating Interactive Computational Modeling in Biology Curricula

While the use of computer tools to simulate complex processes such as computer circuits is normal practice in fields like engineering, the majority of life sciences/biological sciences courses continue to rely on the traditional textbook and memorization approach. To address this issue, we explored the use of the Cell Collective platform as a novel, interactive, and evolving pedagogical tool to foster student engagement, creativity, and higher-level thinking. Cell Collective is a Web-based platform used to create and simulate dynamical models of various biological processes. Students can create models of cells, diseases, or pathways themselves or explore existing models. This technology was implemented in both undergraduate and graduate courses as a pilot study to determine the feasibility of such software at the university level. First, a new (In Silico Biology) class was developed to enable students to learn biology by “building and breaking it” via computer models and their simulations. This class and technology also provide a non-intimidating way to incorporate mathematical and computational concepts into a class with students who have a limited mathematical background. Second, we used the technology to mediate the use of simulations and modeling modules as a learning tool for traditional biological concepts, such as T cell differentiation or cell cycle regulation, in existing biology courses. Results of this pilot application suggest that there is promise in the use of computational modeling and software tools such as Cell Collective to provide new teaching methods in biology and contribute to the implementation of the “Vision and Change” call to action in undergraduate biology education by providing a hands-on approach to biology.     

Efficient Characterization of Parametric Uncertainty of Complex (Bio)chemical Networks

Parametric uncertainty is a particularly challenging and relevant aspect of systems analysis in domains such as systems biology where, both for inference and for assessing prediction uncertainties, it is essential to characterize the system behavior globally in the parameter space. However, current methods based on local approximations or on Monte-Carlo sampling cope only insufficiently with high-dimensional parameter spaces associated with complex network models. Here, we propose an alternative deterministic methodology that relies on sparse polynomial approximations. We propose a deterministic computational interpolation scheme which identifies most significant expansion coefficients adaptively. We present its performance in kinetic model equations from computational systems biology with several hundred parameters and state variables, leading to numerical approximations of the parametric solution on the entire parameter space. The scheme is based on adaptive Smolyak interpolation of the parametric solution at judiciously and adaptively chosen points in parameter space. As Monte-Carlo sampling, it is “non-intrusive” and well-suited for massively parallel implementation, but affords higher convergence rates. This opens up new avenues for large-scale dynamic network analysis by enabling scaling for many applications, including parameter estimation, uncertainty quantification, and systems design.     

Universally sloppy parameter sensitivities in systems biology models

Quantitative computational models play an increasingly important role in modern biology. Such models typically involve many free parameters, and assigning their values is often a substantial obstacle to model development. Directly measuring in vivo biochemical parameters is difficult, and collectively fitting them to other experimental data often yields large parameter uncertainties. Nevertheless, in earlier work we showed in a growth-factor-signaling model that collective fitting could yield well-constrained predictions, even when it left individual parameters very poorly constrained. We also showed that the model had a “sloppy” spectrum of parameter sensitivities, with eigenvalues roughly evenly distributed over many decades. Here we use a collection of models from the literature to test whether such sloppy spectra are common in systems biology. Strikingly, we find that every model we examine has a sloppy spectrum of sensitivities. We also test several consequences of this sloppiness for building predictive models. In particular, sloppiness suggests that collective fits to even large amounts of ideal time-series data will often leave many parameters poorly constrained. Tests over our model collection are consistent with this suggestion. This difficulty with collective fits may seem to argue for direct parameter measurements, but sloppiness also implies that such measurements must be formidably precise and complete to usefully constrain many model predictions. We confirm this implication in our growth-factor-signaling model. Our results suggest that sloppy sensitivity spectra are universal in systems biology models. The prevalence of sloppiness highlights the power of collective fits and suggests that modelers should focus on predictions rather than on parameters.     

Conflict and competition between model-based and model-free control

A large literature has accumulated suggesting that human and animal decision making is driven by at least two systems, and that important functions of these systems can be captured by reinforcement learning algorithms. The “model-free” system caches and uses stimulus–value or stimulus–response associations, and the “model-based” system implements more flexible planning using a model of the world. However, it is not clear how the two systems interact during deliberation and how a single decision emerges from this process, especially when they disagree. Most previous work has assumed that while the systems operate in parallel, they do so independently, and they combine linearly to influence decisions. Using an integrated reinforcement learning/drift-diffusion model, we tested the hypothesis that the two systems interact in a non-linear fashion similar to other situations with cognitive conflict. We differentiated two forms of conflict: action conflict, a binary state representing whether the systems disagreed on the best action, and value conflict, a continuous measure of the extent to which the two systems disagreed on the difference in value between the available options. We found that decisions with greater value conflict were characterized by reduced model-based control and increased caution both with and without action conflict. Action conflict itself (the binary state) acted in the opposite direction, although its effects were less prominent. We also found that between-system conflict was highly correlated with within-system conflict, and although it is less clear a priori why the latter might influence the strength of each system above its standard linear contribution, we could not rule it out. Our work highlights the importance of non-linear conflict effects, and provides new constraints for more detailed process models of decision making. It also presents new avenues to explore with relation to disorders of compulsivity, where an imbalance between systems has been implicated.     

Systems biology approach to developing S2RM-based “systems therapeutics” and naturally induced pluripotent stem cells

The degree to, and the mechanisms through, which stem cells are able to build, maintain, and heal the body have only recently begun to be understood. Much of the stem cell’s power resides in the release of a multitude of molecules, called stem cell released molecules (SRM). A fundamentally new type of therapeutic, namely “systems therapeutic”, can be realized by reverse engineering the mechanisms of the SRM processes. Recent data demonstrates that the composition of the SRM is different for each type of stem cell, as well as for different states of each cell type. Although systems biology has been successfully used to analyze multiple pathways, the approach is often used to develop a small molecule interacting at only one pathway in the system. A new model is emerging in biology where systems biology is used to develop a new technology acting at multiple pathways called “systems therapeutics”. A natural set of healing pathways in the human that uses SRM is instructive and of practical use in developing systems therapeutics. Endogenous SRM processes in the human body use a combination of SRM from two or more stem cell types, designated as S²RM, doing so under various state dependent conditions for each cell type. Here we describe our approach in using state-dependent SRM from two or more stem cell types, S²RM technology, to develop a new class of therapeutics called “systems therapeutics.” Given the ubiquitous and powerful nature of innate S²RM-based healing in the human body, this “systems therapeutic” approach using S²RM technology will be important for the development of anti-cancer therapeutics, antimicrobials, wound care products and procedures, and a number of other therapeutics for many indications.     

Mechanisms of Zero-Lag Synchronization in Cortical Motifs

Zero-lag synchronization between distant cortical areas has been observed in a diversity of experimental data sets and between many different regions of the brain. Several computational mechanisms have been proposed to account for such isochronous synchronization in the presence of long conduction delays: Of these, the phenomenon of “dynamical relaying” – a mechanism that relies on a specific network motif – has proven to be the most robust with respect to parameter mismatch and system noise. Surprisingly, despite a contrary belief in the community, the common driving motif is an unreliable means of establishing zero-lag synchrony. Although dynamical relaying has been validated in empirical and computational studies, the deeper dynamical mechanisms and comparison to dynamics on other motifs is lacking. By systematically comparing synchronization on a variety of small motifs, we establish that the presence of a single reciprocally connected pair – a “resonance pair” – plays a crucial role in disambiguating those motifs that foster zero-lag synchrony in the presence of conduction delays (such as dynamical relaying) from those that do not (such as the common driving triad). Remarkably, minor structural changes to the common driving motif that incorporate a reciprocal pair recover robust zero-lag synchrony. The findings are observed in computational models of spiking neurons, populations of spiking neurons and neural mass models, and arise whether the oscillatory systems are periodic, chaotic, noise-free or driven by stochastic inputs. The influence of the resonance pair is also robust to parameter mismatch and asymmetrical time delays amongst the elements of the motif. We call this manner of facilitating zero-lag synchrony resonance-induced synchronization, outline the conditions for its occurrence, and propose that it may be a general mechanism to promote zero-lag synchrony in the brain.     

Minimal biophysical model of combined antibiotic action

Phenomenological relations such as Ohm’s or Fourier’s law have a venerable history in physics but are still scarce in biology. This situation restrains predictive theory. Here, we build on bacterial “growth laws,” which capture physiological feedback between translation and cell growth, to construct a minimal biophysical model for the combined action of ribosome-targeting antibiotics. Our model predicts drug interactions like antagonism or synergy solely from responses to individual drugs. We provide analytical results for limiting cases, which agree well with numerical results. We systematically refine the model by including direct physical interactions of different antibiotics on the ribosome. In a limiting case, our model provides a mechanistic underpinning for recent predictions of higher-order interactions that were derived using entropy maximization. We further refine the model to include the effects of antibiotics that mimic starvation and the presence of resistance genes. We describe the impact of a starvation-mimicking antibiotic on drug interactions analytically and verify it experimentally. Our extended model suggests a change in the type of drug interaction that depends on the strength of resistance, which challenges established rescaling paradigms. We experimentally show that the presence of unregulated resistance genes can lead to altered drug interaction, which agrees with the prediction of the model. While minimal, the model is readily adaptable and opens the door to predicting interactions of second and higher-order in a broad range of biological systems.     

Biosafety in DIY‐bio laboratories: from hype to policy: Discussions about regulating DIY biology tend to ignore the extent of self‐regulation and oversight of DIY laboratories

Policymakers should treat DIY‐biology laboratories as legitimate parts of the scientific enterprise and pay attention to the role of community norms. Subject Categories: Synthetic Biology & Biotechnology, S&S: Economics & Business, S&S: Ethics

DIY biology – very broadly construed as the practice of biological experiments outside of traditional research environments such as universities, research institutes or companies – has, during the past decade, gained much prominence. This increased attention has raised a number of questions about biosafety and biosecurity, both in the media and by policy makers who are concerned about safety and security lapses in “garage biology”. There are a number of challenges here though when it comes to policies to regulate DIY biology. For a start, the term itself escapes easy definition: synonyms or related terms abound, including garage biotechnology, bio‐hacking, self‐modification/grinding, citizen science, bio‐tinkering, bio‐punk, even transhumanism. Some accounts even use ‘DIY‐bio’ interchangeably with synthetic biology, even though these terms refer to different emerging trends in biology. Some of these terms are more charged than others but each carries its own connotations with regard to practice, norms and legality. As such, conversations about the risk, safety and regulation of DIY‐bio can be fraught.

Synonyms or related terms abound, including garage biotechnology, bio‐hacking, self‐modification/grinding, citizen science, bio‐tinkering, bio‐punk, even transhumanism.

Given the increasing policy discussions about DIY‐bio, it is crucial to consider prevailing practice thoughtfully, and accurately. Key questions that researchers, policy makers and the public need to contemplate include the following: “How do different DIY‐bio spaces exist within regulatory frameworks, and enact cultures of (bio)safety?”, “How are these influenced by norms and governance structures?”, “If something is unregulated, must it follow that it is unsafe?” and “What about the reverse: does regulatory oversight necessarily lead to safer practice?”.The DIY‐bio movement emerged from the convergence of two trends in science and technology. The first one is synthetic biology, which can broadly be defined as a conception of genetic engineering as systematic, modular and programmable. While engineering living organisms is obviously a complex endeavour, synthetic biology has sought to re‐frame it by treating genetic components as inherently modular pieces to be assembled, through rational design processes, into complex but predictable systems. This has prompted many “LEGO” metaphors and a widespread sense of democratisation, making genetic engineering accessible not only to trained geneticists, but also to anyone with an “engineering mindset”.The second, much older, trend stems from hacker‐ and makerspaces, which are – usually not‐for‐profit – community organisations that enable groups of enthusiasts to share expensive or technically complex infrastructure, such as 3D printers or woodworking tools, for their projects. These provide a model of community‐led initiatives based on the sharing of infrastructure, equipment and knowledge. Underpinning these two trends is an economic aspect. Many of the tools of synthetic biology – notably DNA sequencing and synthesis – have seen a dramatic drop in cost, and much of the necessary physical apparatus is available for purchase, often second‐hand, through auction sites.DIY‐bio labs are often set‐up under widely varying management schemes. While some present themselves as community outreach labs focusing on amateur users, others cater specifically to semi‐ or professional members with advanced degrees in the biosciences. Other such spaces act as incubators for biotech startups with an explicitly entrepreneurial culture. Membership agreements, IP arrangements, fees, access and the types of project that are encouraged in each of these spaces can have a profound effect on the science being done.     

What Is Stochastic Resonance? Definitions, Misconceptions, Debates, and Its Relevance to Biology

Stochastic resonance is said to be observed when increases in levels of unpredictable fluctuations—e.g., random noise—cause an increase in a metric of the quality of signal transmission or detection performance, rather than a decrease. This counterintuitive effect relies on system nonlinearities and on some parameter ranges being “suboptimal”. Stochastic resonance has been observed, quantified, and described in a plethora of physical and biological systems, including neurons. Being a topic of widespread multidisciplinary interest, the definition of stochastic resonance has evolved significantly over the last decade or so, leading to a number of debates, misunderstandings, and controversies. Perhaps the most important debate is whether the brain has evolved to utilize random noise in vivo, as part of the “neural code”. Surprisingly, this debate has been for the most part ignored by neuroscientists, despite much indirect evidence of a positive role for noise in the brain. We explore some of the reasons for this and argue why it would be more surprising if the brain did not exploit randomness provided by noise—via stochastic resonance or otherwise—than if it did. We also challenge neuroscientists and biologists, both computational and experimental, to embrace a very broad definition of stochastic resonance in terms of signal-processing “noise benefits”, and to devise experiments aimed at verifying that random variability can play a functional role in the brain, nervous system, or other areas of biology.     

The Impact of Contact Tracing in Clustered Populations

The tracing of potentially infectious contacts has become an important part of the control strategy for many infectious diseases, from early cases of novel infections to endemic sexually transmitted infections. Here, we make use of mathematical models to consider the case of partner notification for sexually transmitted infection, however these models are sufficiently simple to allow more general conclusions to be drawn. We show that, when contact network structure is considered in addition to contact tracing, standard “mass action” models are generally inadequate. To consider the impact of mutual contacts (specifically clustering) we develop an improvement to existing pairwise network models, which we use to demonstrate that ceteris paribus, clustering improves the efficacy of contact tracing for a large region of parameter space. This result is sometimes reversed, however, for the case of highly effective contact tracing. We also develop stochastic simulations for comparison, using simple re-wiring methods that allow the generation of appropriate comparator networks. In this way we contribute to the general theory of network-based interventions against infectious disease.     

Nutritional Systems Biology Modeling: From Molecular Mechanisms to Physiology

The use of computational modeling and simulation has increased in many biological fields, but despite their potential these techniques are only marginally applied in nutritional sciences. Nevertheless, recent applications of modeling have been instrumental in answering important nutritional questions from the cellular up to the physiological levels. Capturing the complexity of today''s important nutritional research questions poses a challenge for modeling to become truly integrative in the consideration and interpretation of experimental data at widely differing scales of space and time. In this review, we discuss a selection of available modeling approaches and applications relevant for nutrition. We then put these models into perspective by categorizing them according to their space and time domain. Through this categorization process, we identified a dearth of models that consider processes occurring between the microscopic and macroscopic scale. We propose a “middle-out” strategy to develop the required full-scale, multilevel computational models. Exhaustive and accurate phenotyping, the use of the virtual patient concept, and the development of biomarkers from “-omics” signatures are identified as key elements of a successful systems biology modeling approach in nutrition research—one that integrates physiological mechanisms and data at multiple space and time scales.     

The importance of bottlenecks in protein networks: correlation with gene essentiality and expression dynamics

It has been a long-standing goal in systems biology to find relations between the topological properties and functional features of protein networks. However, most of the focus in network studies has been on highly connected proteins (“hubs”). As a complementary notion, it is possible to define bottlenecks as proteins with a high betweenness centrality (i.e., network nodes that have many “shortest paths” going through them, analogous to major bridges and tunnels on a highway map). Bottlenecks are, in fact, key connector proteins with surprising functional and dynamic properties. In particular, they are more likely to be essential proteins. In fact, in regulatory and other directed networks, betweenness (i.e., “bottleneck-ness”) is a much more significant indicator of essentiality than degree (i.e., “hub-ness”). Furthermore, bottlenecks correspond to the dynamic components of the interaction network—they are significantly less well coexpressed with their neighbors than nonbottlenecks, implying that expression dynamics is wired into the network topology.     

A Fundamental Trade-off in Covalent Switching and Its Circumvention by Enzyme Bifunctionality in Glucose Homeostasis

Covalent modification provides a mechanism for modulating molecular state and regulating physiology. A cycle of competing enzymes that add and remove a single modification can act as a molecular switch between “on” and “off” and has been widely studied as a core motif in systems biology. Here, we exploit the recently developed “linear framework” for time scale separation to determine the general principles of such switches. These methods are not limited to Michaelis-Menten assumptions, and our conclusions hold for enzymes whose mechanisms may be arbitrarily complicated. We show that switching efficiency improves with increasing irreversibility of the enzymes and that the on/off transition occurs when the ratio of enzyme levels reaches a value that depends only on the rate constants. Fluctuations in enzyme levels, which habitually occur due to cellular heterogeneity, can cause flipping back and forth between on and off, leading to incoherent mosaic behavior in tissues, that worsens as switching becomes sharper. This trade-off can be circumvented if enzyme levels are correlated. In particular, if the competing catalytic domains are on the same protein but do not influence each other, the resulting bifunctional enzyme can switch sharply while remaining coherent. In the mammalian liver, the switch between glycolysis and gluconeogenesis is regulated by the bifunctional 6-phosphofructo-2-kinase/fructose-2,6-bisphosphatase (PFK-2/FBPase-2). We suggest that bifunctionality of PFK-2/FBPase-2 complements the metabolic zonation of the liver by ensuring coherent switching in response to insulin and glucagon.     

Some Formal Approaches to the Analysis of Kinetic Data in Terms of Linear Compartmental Systems

A formal approach to the routine analysis of kinetic data in terms of linear compartmental systems is presented. The methods of analysis are general in that they include much of the theory in common use, such as direct solution of differential equations, integral equations, transfer functions, fitting of data to sums of exponentials, matrix solutions, etc. The key to the formalism presented lies in the fact that a basic operational unit—called “compartment”—has been defined, in terms of which physical and mathematical models as well as input and output functions can be expressed. Additional features for calculating linear combinations of functions and for setting linear dependence relations between parameters add to the versatility of this method. The actual computations for the values of model parameters to yield a least squares fit of the data are performed on a digital computer. A general computer program was developed that permits the routine fitting of data and the evolution of models.     

Broadband Criticality of Human Brain Network Synchronization

Self-organized criticality is an attractive model for human brain dynamics, but there has been little direct evidence for its existence in large-scale systems measured by neuroimaging. In general, critical systems are associated with fractal or power law scaling, long-range correlations in space and time, and rapid reconfiguration in response to external inputs. Here, we consider two measures of phase synchronization: the phase-lock interval, or duration of coupling between a pair of (neurophysiological) processes, and the lability of global synchronization of a (brain functional) network. Using computational simulations of two mechanistically distinct systems displaying complex dynamics, the Ising model and the Kuramoto model, we show that both synchronization metrics have power law probability distributions specifically when these systems are in a critical state. We then demonstrate power law scaling of both pairwise and global synchronization metrics in functional MRI and magnetoencephalographic data recorded from normal volunteers under resting conditions. These results strongly suggest that human brain functional systems exist in an endogenous state of dynamical criticality, characterized by a greater than random probability of both prolonged periods of phase-locking and occurrence of large rapid changes in the state of global synchronization, analogous to the neuronal “avalanches” previously described in cellular systems. Moreover, evidence for critical dynamics was identified consistently in neurophysiological systems operating at frequency intervals ranging from 0.05–0.11 to 62.5–125 Hz, confirming that criticality is a property of human brain functional network organization at all frequency intervals in the brain's physiological bandwidth.     

Thunderstruck: The ACDC model of flexible sequences and rhythms in recurrent neural circuits

Adaptive sequential behavior is a hallmark of human cognition. In particular, humans can learn to produce precise spatiotemporal sequences given a certain context. For instance, musicians can not only reproduce learned action sequences in a context-dependent manner, they can also quickly and flexibly reapply them in any desired tempo or rhythm without overwriting previous learning. Existing neural network models fail to account for these properties. We argue that this limitation emerges from the fact that sequence information (i.e., the position of the action) and timing (i.e., the moment of response execution) are typically stored in the same neural network weights. Here, we augment a biologically plausible recurrent neural network of cortical dynamics to include a basal ganglia-thalamic module which uses reinforcement learning to dynamically modulate action. This “associative cluster-dependent chain” (ACDC) model modularly stores sequence and timing information in distinct loci of the network. This feature increases computational power and allows ACDC to display a wide range of temporal properties (e.g., multiple sequences, temporal shifting, rescaling, and compositionality), while still accounting for several behavioral and neurophysiological empirical observations. Finally, we apply this ACDC network to show how it can learn the famous “Thunderstruck” song intro and then flexibly play it in a “bossa nova” rhythm without further training.     

Translational systems biology of inflammation

Inflammation is a complex, multi-scale biologic response to stress that is also required for repair and regeneration after injury. Despite the repository of detailed data about the cellular and molecular processes involved in inflammation, including some understanding of its pathophysiology, little progress has been made in treating the severe inflammatory syndrome of sepsis. To address the gap between basic science knowledge and therapy for sepsis, a community of biologists and physicians is using systems biology approaches in hopes of yielding basic insights into the biology of inflammation. “Systems biology” is a discipline that combines experimental discovery with mathematical modeling to aid in the understanding of the dynamic global organization and function of a biologic system (cell to organ to organism). We propose the term translational systems biology for the application of similar tools and engineering principles to biologic systems with the primary goal of optimizing clinical practice. We describe the efforts to use translational systems biology to develop an integrated framework to gain insight into the problem of acute inflammation. Progress in understanding inflammation using translational systems biology tools highlights the promise of this multidisciplinary field. Future advances in understanding complex medical problems are highly dependent on methodological advances and integration of the computational systems biology community with biologists and clinicians.     

Many chronological aging clocks can be found throughout the epigenome: Implications for quantifying biological aging

Epigenetic alterations are a hallmark of aging and age‐related diseases. Computational models using DNA methylation data can create “epigenetic clocks” which are proposed to reflect “biological” aging. Thus, it is important to understand the relationship between predictive clock sites and aging biology. To do this, we examined over 450,000 methylation sites from 9,699 samples. We found ~20% of the measured genomic cytosines can be used to make many different epigenetic clocks whose age prediction performance surpasses that of telomere length. Of these predictive sites, the average methylation change over a lifetime was small (~1.5%) and these sites were under‐represented in canonical regions of epigenetic regulation. There was only a weak association between “accelerated” epigenetic aging and disease. We also compare tissue‐specific and pan‐tissue clock performance. This is critical to applying clocks both to new sample sets in basic research, as well as understanding if clinically available tissues will be feasible samples to evaluate “epigenetic aging” in unavailable tissues (e.g., brain). Despite the reproducible and accurate age predictions from DNA methylation data, these findings suggest they may have limited utility as currently designed in understanding the molecular biology of aging and may not be suitable as surrogate endpoints in studies of anti‐aging interventions. Purpose‐built clocks for specific tissues age ranges or phenotypes may perform better for their specific purpose. However, if purpose‐built clocks are necessary for meaningful predictions, then the utility of clocks and their application in the field needs to be considered in that context.