The propagation of the nerve impulse.

A partial differential equation for the propagated action potential is derived using symmetry, charge conservation, and Ohm's law. Charge conservation analysis explicitly includes the gating charge when applied in the laboratory frame. When applied in the system of reference in which capacitive currents are zero, it yields a relation between orthogonal components of the ionic current allowing us to express the nonlinear ionic current in terms of the voltage-dependent membrane capacitance C(V) and the axial current that satisfies Ohm's law. The ionic current is shown to behave as C(V)V[C(V)V2]' at the foot of the action potential while the gating current behaves as C(V)V[Cg(V)V]' where Cg(V) is the capacitance associated with gating. Improved knowledge of the nonlinear current makes it possible to describe the propagated action potential in an approximated way with quasilinear partial differential equations. These equations have analytical solutions that travel with constant velocity, retain their shape, and account for other properties of the action potential. Furthermore, the quasilinear approximation is shown to be equivalent to the FitzHugh-Nagumo equation without recovery making apparent its physical content.     

Discrete time piecewise affine models of genetic regulatory networks

We introduce simple models of genetic regulatory networks and we proceed to the mathematical analysis of their dynamics. The models are discrete time dynamical systems generated by piecewise affine contracting mappings whose variables represent gene expression levels. These models reduce to boolean networks in one limiting case of a parameter, and their asymptotic dynamics approaches that of a differential equation in another limiting case of this parameter. For intermediate values, the model present an original phenomenology which is argued to be due to delay effects. This phenomenology is not limited to piecewise affine model but extends to smooth nonlinear discrete time models of regulatory networks. In a first step, our analysis concerns general properties of networks on arbitrary graphs (characterisation of the attractor, symbolic dynamics, Lyapunov stability, structural stability, symmetries, etc). In a second step, focus is made on simple circuits for which the attractor and its changes with parameters are described. In the negative circuit of 2 genes, a thorough study is presented which concern stable (quasi-)periodic oscillations governed by rotations on the unit circle – with a rotation number depending continuously and monotonically on threshold parameters. These regular oscillations exist in negative circuits with arbitrary number of genes where they are most likely to be observed in genetic systems with non-negligible delay effects.     

A model of beta-cell mass, insulin, and glucose kinetics: pathways to diabetes

Diabetes is a disease of the glucose regulatory system that is associated with increased morbidity and early mortality. The primary variables of this system are beta-cell mass, plasma insulin concentrations, and plasma glucose concentrations. Existing mathematical models of glucose regulation incorporate only glucose and/or insulin dynamics. Here we develop a novel model of beta -cell mass, insulin, and glucose dynamics, which consists of a system of three nonlinear ordinary differential equations, where glucose and insulin dynamics are fast relative to beta-cell mass dynamics. For normal parameter values, the model has two stable fixed points (representing physiological and pathological steady states), separated on a slow manifold by a saddle point. Mild hyperglycemia leads to the growth of the beta -cell mass (negative feedback) while extreme hyperglycemia leads to the reduction of the beta-cell mass (positive feedback). The model predicts that there are three pathways in prolonged hyperglycemia: (1) the physiological fixed point can be shifted to a hyperglycemic level (regulated hyperglycemia), (2) the physiological and saddle points can be eliminated (bifurcation), and (3) progressive defects in glucose and/or insulin dynamics can drive glucose levels up at a rate faster than the adaptation of the beta -cell mass which can drive glucose levels down (dynamical hyperglycemia).     

From global to local: exploring the relationship between parameters and behaviors in models of electrical excitability

Models of electrical activity in excitable cells involve nonlinear interactions between many ionic currents. Changing parameters in these models can produce a variety of activity patterns with sometimes unexpected effects. Further more, introducing new currents will have different effects depending on the initial parameter set. In this study we combined global sampling of parameter space and local analysis of representative parameter sets in a pituitary cell model to understand the effects of adding K ⁺ conductances, which mediate some effects of hormone action on these cells. Global sampling ensured that the effects of introducing K ⁺ conductances were captured across a wide variety of contexts of model parameters. For each type of K ⁺ conductance we determined the types of behavioral transition that it evoked. Some transitions were counterintuitive, and may have been missed without the use of global sampling. In general, the wide range of transitions that occurred when the same current was applied to the model cell at different locations in parameter space highlight the challenge of making accurate model predictions in light of cell-to-cell heterogeneity. Finally, we used bifurcation analysis and fast/slow analysis to investigate why specific transitions occur in representative individual models. This approach relies on the use of a graphics processing unit (GPU) to quickly map parameter space to model behavior and identify parameter sets for further analysis. Acceleration with modern low-cost GPUs is particularly well suited to exploring the moderate-sized (5-20) parameter spaces of excitable cell and signaling models.     

Systematic identifiability testing for unambiguous mechanistic modeling – application to JAK-STAT,MAP kinase,and NF-κB signaling pathway models

Background  

When creating mechanistic mathematical models for biological signaling processes it is tempting to include as many known biochemical interactions into one large model as possible. For the JAK-STAT, MAP kinase, and NF-κB pathways a lot of biological insight is available, and as a consequence, large mathematical models have emerged. For large models the question arises whether unknown model parameters can uniquely be determined by parameter estimation from measured data. Systematic approaches to answering this question are indispensable since the uniqueness of model parameter values is essential for predictive mechanistic modeling.     

Reconstructing Mammalian Sleep Dynamics with Data Assimilation

Data assimilation is a valuable tool in the study of any complex system, where measurements are incomplete, uncertain, or both. It enables the user to take advantage of all available information including experimental measurements and short-term model forecasts of a system. Although data assimilation has been used to study other biological systems, the study of the sleep-wake regulatory network has yet to benefit from this toolset. We present a data assimilation framework based on the unscented Kalman filter (UKF) for combining sparse measurements together with a relatively high-dimensional nonlinear computational model to estimate the state of a model of the sleep-wake regulatory system. We demonstrate with simulation studies that a few noisy variables can be used to accurately reconstruct the remaining hidden variables. We introduce a metric for ranking relative partial observability of computational models, within the UKF framework, that allows us to choose the optimal variables for measurement and also provides a methodology for optimizing framework parameters such as UKF covariance inflation. In addition, we demonstrate a parameter estimation method that allows us to track non-stationary model parameters and accommodate slow dynamics not included in the UKF filter model. Finally, we show that we can even use observed discretized sleep-state, which is not one of the model variables, to reconstruct model state and estimate unknown parameters. Sleep is implicated in many neurological disorders from epilepsy to schizophrenia, but simultaneous observation of the many brain components that regulate this behavior is difficult. We anticipate that this data assimilation framework will enable better understanding of the detailed interactions governing sleep and wake behavior and provide for better, more targeted, therapies.     

Parameter inversion estimation in photosynthetic models: Impact of different simulation methods

When we apply ecological models in environmental management, we must assess the accuracy of parameter estimation and its impact on model predictions. Parameters estimated by conventional techniques tend to be nonrobust and require excessive computational resources. However, optimization algorithms are highly robust and generally exhibit convergence of parameter estimation by inversion with nonlinear models. They can simultaneously generate a large number of parameter estimates using an entire data set. In this study, we tested four inversion algorithms (simulated annealing, shuffled complex evolution, particle swarm optimization, and the genetic algorithm) to optimize parameters in photosynthetic models depending on different temperatures. We investigated if parameter boundary values and control variables influenced the accuracy and efficiency of the various algorithms and models. We obtained optimal solutions with all of the inversion algorithms tested if the parameter bounds and control variables were constrained properly. However, the efficiency of processing time use varied with the control variables obtained. In addition, we investigated if temperature dependence formalization impacted optimally the parameter estimation process. We found that the model with a peaked temperature response provided the best fit to the data.     

The feasibility of genome-scale biological network inference using Graphics Processing Units

Systems research spanning fields from biology to finance involves the identification of models to represent the underpinnings of complex systems. Formal approaches for data-driven identification of network interactions include statistical inference-based approaches and methods to identify dynamical systems models that are capable of fitting multivariate data. Availability of large data sets and so-called ‘big data’ applications in biology present great opportunities as well as major challenges for systems identification/reverse engineering applications. For example, both inverse identification and forward simulations of genome-scale gene regulatory network models pose compute-intensive problems. This issue is addressed here by combining the processing power of Graphics Processing Units (GPUs) and a parallel reverse engineering algorithm for inference of regulatory networks. It is shown that, given an appropriate data set, information on genome-scale networks (systems of 1000 or more state variables) can be inferred using a reverse-engineering algorithm in a matter of days on a small-scale modern GPU cluster.     

Integration of kinetic information on yeast sphingolipid metabolism in dynamical pathway models

For the first time, kinetic information from the literature was collected and used to construct integrative dynamical mathematical models of sphingolipid metabolism. One model was designed primarily with kinetic equations in the tradition of Michaelis and Menten whereas the other two models were designed as alternative power-law models within the framework of Biochemical Systems Theory. Each model contains about 50 variables, about a quarter of which are dependent (state) variables, while the others are independent inputs and enzyme activities that are considered constant. The models account for known regulatory signals that exert control over the pathway. Standard mathematical testing, repeated revisiting of the literature, and numerous rounds of amendments and refinements resulted in models that are stable and rather insensitive to perturbations in inputs or parameter values. The models also appear to be compatible with the modest amount of experimental experience that lends itself to direct comparisons. Even though the three models are based on different mathematical representations, they show dynamic responses to a variety of perturbations and changes in conditions that are essentially equivalent for small perturbations and similar for large perturbations. The kinetic information used for model construction and the models themselves can serve as a starting point for future analyses and refinements.     

Quantifying nonlinear anisotropic elastic material properties of biological tissue by use of membrane inflation

Determination of material parameters for soft tissue frequently involves regression of material parameters for nonlinear, anisotropic constitutive models against experimental data from heterogeneous tests. Here, parameter estimation based on membrane inflation is considered. A four parameter nonlinear, anisotropic hyperelastic strain energy function was used to model the material, in which the parameters are cast in terms of key response features. The experiment was simulated using finite element (FE) analysis in order to predict the experimental measurements of pressure versus profile strain. Material parameter regression was automated using inverse FE analysis; parameter values were updated by use of both local and global techniques, and the ability of these techniques to efficiently converge to a best case was examined. This approach provides a framework in which additional experimental data, including surface strain measurements or local structural information, may be incorporated in order to quantify heterogeneous nonlinear material properties.     

Active Learning to Understand Infectious Disease Models and Improve Policy Making

Modeling plays a major role in policy making, especially for infectious disease interventions but such models can be complex and computationally intensive. A more systematic exploration is needed to gain a thorough systems understanding. We present an active learning approach based on machine learning techniques as iterative surrogate modeling and model-guided experimentation to systematically analyze both common and edge manifestations of complex model runs. Symbolic regression is used for nonlinear response surface modeling with automatic feature selection. First, we illustrate our approach using an individual-based model for influenza vaccination. After optimizing the parameter space, we observe an inverse relationship between vaccination coverage and cumulative attack rate reinforced by herd immunity. Second, we demonstrate the use of surrogate modeling techniques on input-response data from a deterministic dynamic model, which was designed to explore the cost-effectiveness of varicella-zoster virus vaccination. We use symbolic regression to handle high dimensionality and correlated inputs and to identify the most influential variables. Provided insight is used to focus research, reduce dimensionality and decrease decision uncertainty. We conclude that active learning is needed to fully understand complex systems behavior. Surrogate models can be readily explored at no computational expense, and can also be used as emulator to improve rapid policy making in various settings.     

The calcium-independent transient outward potassium current in isolated ferret right ventricular myocytes. I. Basic characterization and kinetic analysis

Enzymatically isolated myocytes from ferret right ventricles (12-16 wk, male) were studied using the whole cell patch clamp technique. The macroscopic properties of a transient outward K+ current I(to) were quantified. I(to) is selective for K+, with a PNa/PK of 0.082. Activation of I(to) is a voltage-dependent process, with both activation and inactivation being independent of Na+ or Ca2+ influx. Steady-state inactivation is well described by a single Boltzmann relationship (V1/2 = -13.5 mV; k = 5.6 mV). Substantial inactivation can occur during a subthreshold depolarization without any measurable macroscopic current. Both development of and recovery from inactivation are well described by single exponential processes. Ensemble averages of single I(to) channel currents recorded in cell-attached patches reproduce macroscopic I(to) and indicate that inactivation is complete at depolarized potentials. The overall inactivation/recovery time constant curve has a bell-shaped potential dependence that peaks between -10 and -20 mV, with time constants (22 degrees C) ranging from 23 ms (-90 mV) to 304 ms (-10 mV). Steady-state activation displays a sigmoidal dependence on membrane potential, with a net aggregate half- activation potential of +22.5 mV. Activation kinetics (0 to +70 mV, 22 degrees C) are rapid, with I(to) peaking in approximately 5-15 ms at +50 mV. Experiments conducted at reduced temperatures (12 degrees C) demonstrate that activation occurs with a time delay. A nonlinear least- squares analysis indicates that three closed kinetic states are necessary and sufficient to model activation. Derived time constants of activation (22 degrees C) ranged from 10 ms (+10 mV) to 2 ms (+70 mV). Within the framework of Hodgkin-Huxley formalism, Ito gating can be described using an a3i formulation.     

Determining the contributions of divisive and subtractive feedback in the Hodgkin-Huxley model

The Hodgkin-Huxley (HH) model is the basis for numerous neural models. There are two negative feedback processes in the HH model that regulate rhythmic spiking. The first is an outward current with an activation variable n that has an opposite influence to the excitatory inward current and therefore provides subtractive negative feedback. The other is the inactivation of an inward current with an inactivation variable h that reduces the amount of positive feedback and therefore provides divisive feedback. Rhythmic spiking can be obtained with either negative feedback process, so we ask what is gained by having two feedback processes. We also ask how the different negative feedback processes contribute to spiking. We show that having two negative feedback processes makes the HH model more robust to changes in applied currents and conductance densities than models that possess only one negative feedback variable. We also show that the contributions made by the subtractive and divisive feedback variables are not static, but depend on time scales and conductance values. In particular, they contribute differently to the dynamics in Type I versus Type II neurons.     

A comparative evaluation of models of cinnabar moth dynamics

Summary 1. A complex model of cinnabar moth dynamics proposed by Dempster and Lakhani (1979) with 23 parameters is reduced to a single equation with five parameters, and the behaviour of the reduced model shown to explain most features of the full model. 2. The efficiency of the full model is compared with the reduced model and with two even simpler models (the two parameter discrete logistic and a four parameter model based on a step-function for mortality) in their abilities to describe time series data of cinnabar moth population densities from Weeting Heath. Models with more parameters were not significantly better than few-parameter models in describing population trajectories. 3. Models that included a driving variable (in this case observed rainfall data) were no better at describing the data than simpler models without driving variables. It appears, therefore, that the routine inclusion of driving variables may be counterproductive, unless there is compelling empirical or theoretical evidence of their importance and the mode of action of the driving variables can be modelled mechanistically. For example, the regression model used to describe the relationship between rainfall and plant biomass in Dempster and Lakhani (1979), breaks down if rainfall is assumed to be constant, because there is no explicit model for the regulation of plant biomass. 4. The parameter values of the cinnabar-ragwort interaction suggest that cinnabar moth dynamics may be chaotic. Whether or not field data exhibit chaos or environmental stochasticity (or a mixture of both) is impossible to determine from inspection of time series data on population density. There is an urgent need for experimental and theoretical protocols to disentangle these two sources of population fluctuation.     

Cellular signaling identifiability analysis: A case study

Two primary purposes for mathematical modeling in cell biology are (1) simulation for making predictions of experimental outcomes and (2) parameter estimation for drawing inferences from experimental data about unobserved aspects of biological systems. While the former purpose has become common in the biological sciences, the latter is less common, particularly when studying cellular and subcellular phenomena such as signaling—the focus of the current study. Data are difficult to obtain at this level. Therefore, even models of only modest complexity can contain parameters for which the available data are insufficient for estimation. In the present study, we use a set of published cellular signaling models to address issues related to global parameter identifiability. That is, we address the following question: assuming known time courses for some model variables, which parameters is it theoretically impossible to estimate, even with continuous, noise-free data? Following an introduction to this problem and its relevance, we perform a full identifiability analysis on a set of cellular signaling models using DAISY (Differential Algebra for the Identifiability of SYstems). We use our analysis to bring to light important issues related to parameter identifiability in ordinary differential equation (ODE) models. We contend that this is, as of yet, an under-appreciated issue in biological modeling and, more particularly, cell biology.     

Using isotopomer path tracing to quantify metabolic fluxes in pathway models containing reversible reactions

As a more complete picture of the genetic and enzymatic composition of cells becomes available, there is a growing need to describe how cellular regulatory elements interact with the cellular environment to affect cell physiology. One means for describing intracellular regulatory mechanisms is concurrent measurement of multiple metabolic pathways and their interactions by metabolic flux analysis. Flux of carbon through a metabolic pathway responds to all cellular regulatory systems, including changes in enzyme and substrate concentrations, enzyme activation or inhibition, and ultimately genetic control. The extent to which metabolic flux analysis can describe cellular physiology depends on the number of pathways in the model and the quality of the data. Intracellular information is obtainable from isotopic tracer experiments, the most extensive being the determination of the isotopomer distribution, or specific labeling pattern, of intracellular metabolites. We present a rapid and novel solution method that determines the flux of carbon through complex pathway models using isotopomer data. This time-consuming problem was solved with the introduction of isotopomer path tracing, which drastically reduces the number of isotopomer variables to the number of isotopomers observed experimentally. We propose a partitioned solution method that takes advantage of the nearly linear relationship between fluxes and isotopomers. Whereas the stoichiometric matrix and the isotopomer matrix are invertible, simulated annealing and the Newton-Raphson method are used for the nonlinear components. Reversible reactions are described by a new parameter, the association factor, which scales hyperbolically with the rate of metabolite exchange. Automating the solution method permits a variety of models to be compared, thus enhancing the accuracy of results. A simplified example that contains all of the complexities of a comprehensive pathway model is presented. Copyright John Wiley & Sons, Inc.     

Inference of S-system models of gene regulatory networks using immune algorithm

The S-system model is one of the nonlinear differential equation models of gene regulatory networks, and it can describe various dynamics of the relationships among genes. If we successfully infer rigorous S-system model parameters that describe a target gene regulatory network, we can simulate gene expressions mathematically. However, the problem of finding an optimal S-system model parameter is too complex to be solved analytically. Thus, some heuristic search methods that offer approximate solutions are needed for reducing the computational time. In previous studies, several heuristic search methods such as Genetic Algorithms (GAs) have been applied to the parameter search of the S-system model. However, they have not achieved enough estimation accuracy. One of the conceivable reasons is that the mechanisms to escape local optima. We applied an Immune Algorithm (IA) to search for the S-system parameters. IA is also a heuristic search method, which is inspired by the biological mechanism of acquired immunity. Compared to GA, IA is able to search large solution space, thereby avoiding local optima, and have multiple candidates of the solutions. These features work well for searching the S-system model. Actually, our algorithm showed higher performance than GA for both simulation and real data analyses.     

The retrograde frequency response of passive dendritic trees constrains the nonlinear firing behaviour of a reduced neuron model

Our goal was to investigate how the propagation of alternating signals (i.e. AC), like action potentials, into the dendrites influenced nonlinear firing behaviour of motor neurons using a systematically reduced neuron model. A recently developed reduced modeling approach using only steady-current (i.e. DC) signaling was analytically expanded to retain features of the frequency-response analysis carried out in multicompartment anatomically reconstructed models. Bifurcation analysis of the extended model showed that the typically overlooked parameter of AC amplitude attenuation was positively correlated with the current threshold for the activation of a plateau potential in the dendrite. Within the multiparameter space map of the reduced model the region demonstrating "fully-bistable" firing was bounded by directional DC attenuation values that were negatively correlated to AC attenuation. Based on these results we conclude that analytically derived reduced models of dendritic trees should be fit on DC and AC signaling, as both are important biophysical parameters governing the nonlinear firing behaviour of motor neurons.