Scale-up on basis of structured mixing models: A new concept

A new scale-up concept based upon mixing models for bioreactors equipped with Rushton turbines using the tanks-in-series concept is presented. The physical mixing model includes four adjustable parameters, i.e., radial and axial circulation time, number of ideally mixed elements in one cascade, and the volume of the ideally mixed turbine region. The values of the model parameters were adjusted with the application of a modified Monte-Carlo optimization method, which fitted the simulated response function to the experimental curve. The number of cascade elements turned out to be constant (N = 4). The model parameter radial circulation time is in good agreement with the one obtained by the pumping capacity. In case of remaining parameters a first or second order formal equation was developed, including four operational parameters (stirring and aeration intensity, scale, viscosity). This concept can be extended to several other types of bioreactors as well, and it seems to be a suitable tool to compare the bioprocess performance of different types of bioreactors. (c) 1994 John Wiley & Sons, Inc.     

Determination of best-fit potential parameters for a reactive force field using a genetic algorithm

The ReaxFF interatomic potential, used for organic materials, involves more than 600 adjustable parameters, the best-fit values of which must be determined for different materials. A new method of determining the set of best-fit parameters for specific molecules containing carbon, hydrogen, nitrogen and oxygen is presented, based on a parameter reduction technique followed by genetic algorithm (GA) minimization. This work has two novel features. The first is the use of a parameter reduction technique to determine which subset of parameters plays a significant role for the species of interest; this is necessary to reduce the optimization space to manageable levels. The second is the application of the GA technique to a complex potential (ReaxFF) with a very large number of adjustable parameters, which implies a large parameter space for optimization. In this work, GA has been used to optimize the parameter set to determine best-fit parameters that can reproduce molecular properties to within a given accuracy. As a test problem, the use of the algorithm has been demonstrated for nitromethane and its decomposition products.     

Targeted maximum likelihood estimation of the parameter of a marginal structural model

Targeted maximum likelihood estimation is a versatile tool for estimating parameters in semiparametric and nonparametric models. We work through an example applying targeted maximum likelihood methodology to estimate the parameter of a marginal structural model. In the case we consider, we show how this can be easily done by clever use of standard statistical software. We point out differences between targeted maximum likelihood estimation and other approaches (including estimating function based methods). The application we consider is to estimate the effect of adherence to antiretroviral medications on virologic failure in HIV positive individuals.     

Instrumental noise estimates stabilize and quantify endothelial cell micro-impedance barrier function parameter estimates

A novel transcellular micro-impedance biosensor, referred to as the electric cell-substrate impedance sensor or ECIS, has become increasingly applied to the study and quantification of endothelial cell physiology. In principle, frequency dependent impedance measurements obtained from this sensor can be used to estimate the cell–cell and cell–matrix impedance components of endothelial cell barrier function based on simple geometric models. Few studies, however, have examined the numerical optimization of these barrier function parameters and established their error bounds. This study, therefore, illustrates the implementation of a multi-response Levenberg–Marquardt algorithm that includes instrumental noise estimates and applies it to frequency dependent porcine pulmonary artery endothelial cell impedance measurements. The stability of cell–cell, cell–matrix and membrane impedance parameter estimates based on this approach is carefully examined, and several forms of parameter instability and refinement illustrated. Including frequency dependent noise variance estimates in the numerical optimization reduced the parameter value dependence on the frequency range of measured impedances. The increased stability provided by a multi-response non-linear fit over one-dimensional algorithms indicated that both real and imaginary data should be used in the parameter optimization. Error estimates based on single fits and Monte Carlo simulations showed that the model barrier parameters were often highly correlated with each other. Independently resolving the different parameters can, therefore, present a challenge to the experimentalist and demand the use of non-linear multivariate statistical methods when comparing different sets of parameters.     

Simplified method for the computation of parameters of power-law rate equations from time-series

Modeling biological processes from time-series data is a resourceful procedure which has received much attention in the literature. For models established in the context of non-linear differential equations, parameter-dependent phenomenological tentative response functions are tested by comparing would-be solutions of those models to the experimental time-series. Those values of the parameters for which a tested solution is a best fit are then retained. It is done with the help of some appropriate optimization algorithm which simplifies the searching procedure within the range of variability of the parameters that are to be estimated. The procedure works well in problems with a small number of adjustable parameters or/and with narrow searching ranges. However, it may start to be problematic for models with a large number of problem parameters inasmuch as convergence to the best fit is not necessarily ensured. In this case, a reduction in size of the parameter estimation problem must be undertaken. We presently address this issue by proposing a systematic procedure that does so in problems in which the system's response to a sufficiently small pulse perturbation of steady-state can be obtained. The response is then assumed to be a solution of the linearized equations, the Jacobian of which can be retrieved by a simple multilinear regression. The calculated n(2) Jacobian entries provide as many relationships among problem parameters, thus cutting substantially the size of the starting problem. After this preliminary treatment is applied, only (kappa-n(2)) of the initial kappa adjustable parameters are left for evaluation by means of a non-linear optimization procedure. The benefits of the present variant are both in economy of computation and in accuracy in determining the parameter values. The performance of the method is established under different circumstances. It is illustrated in the context of power-law rates, although this does not preclude its applicability to more general functional responses.     

A method for parameter optimization in computational biology

Models in computational biology, such as those used in binding, docking, and folding, are often empirical and have adjustable parameters. Because few of these models are yet fully predictive, the problem may be nonoptimal choices of parameters. We describe an algorithm called ENPOP (energy function parameter optimization) that improves-and sometimes optimizes-the parameters for any given model and for any given search strategy that identifies the stable state of that model. ENPOP iteratively adjusts the parameters simultaneously to move the model global minimum energy conformation for each of m different molecules as close as possible to the true native conformations, based on some appropriate measure of structural error. A proof of principle is given for two very different test problems. The first involves three different two-dimensional model protein molecules having 12 to 37 monomers and four parameters in common. The parameters converge to the values used to design the model native structures. The second problem involves nine bumpy landscapes, each having between 4 and 12 degrees of freedom. For the three adjustable parameters, the globally optimal values are known in advance. ENPOP converges quickly to the correct parameter set.     

Simultaneous versus sequential optimal experiment design for the identification of multi-parameter microbial growth kinetics as a function of temperature

Optimal experiment design for parameter estimation (OED/PE) has become a popular tool for efficient and accurate estimation of kinetic model parameters. When the kinetic model under study encloses multiple parameters, different optimization strategies can be constructed. The most straightforward approach is to estimate all parameters simultaneously from one optimal experiment (single OED/PE strategy). However, due to the complexity of the optimization problem or the stringent limitations on the system's dynamics, the experimental information can be limited and parameter estimation convergence problems can arise. As an alternative, we propose to reduce the optimization problem to a series of two-parameter estimation problems, i.e., an optimal experiment is designed for a combination of two parameters while presuming the other parameters known. Two different approaches can be followed: (i) all two-parameter optimal experiments are designed based on identical initial parameter estimates and parameters are estimated simultaneously from all resulting experimental data (global OED/PE strategy), and (ii) optimal experiments are calculated and implemented sequentially whereby the parameter values are updated intermediately (sequential OED/PE strategy).This work exploits OED/PE for the identification of the Cardinal Temperature Model with Inflection (CTMI) (Rosso et al., 1993). This kinetic model describes the effect of temperature on the microbial growth rate and encloses four parameters. The three OED/PE strategies are considered and the impact of the OED/PE design strategy on the accuracy of the CTMI parameter estimation is evaluated. Based on a simulation study, it is observed that the parameter values derived from the sequential approach deviate more from the true parameters than the single and global strategy estimates. The single and global OED/PE strategies are further compared based on experimental data obtained from design implementation in a bioreactor. Comparable estimates are obtained, but global OED/PE estimates are, in general, more accurate and reliable.     

Elastic properties of cancellous bone derived from finite element models of parameterized microstructure cells

Evaluation of constitutive properties of cancellous bone and their relationships to microstructural parameters is a crucial issue in analysis of stresses and strains in bone tissues and simulation of their remodelling. Known limitations of experimental methods as well as of the micro-FE techniques make the analysis and homogenization of 'equivalent' trabecular microstructures an advantageous tool for this task. In this study, parameterized orthotropic constitutive models of cancellous bone are derived from finite element analysis of repeatable microstructure cells. Two cell types are analysed: cube- and prism-based. The models are fully three-dimensional, have realistic curvilinear shapes and are parameterized with three shape parameters. Variation of the parameters allows to imitate most of the typical microstructure patterns observed in real bones, along with variety of intermediate geometries. Finite element models of cells are generated by a special-purpose structured mesh generator for any arbitrary set of shape parameter values. Six static numerical tests are performed for an exhaustive number of parameter value sets (microstructure instances). Multi-point boundary conditions imposed on the models ensure mutual fitting of deformed neighbouring cells. Values of computed stresses allow to determine all coefficients of elastic orthotropic stiffness matrix. Results have a form of tabularized functions of elastic constants versus the shape parameters. Comparison of the results with micro-FE data obtained for a large set of cancellous bone specimens proves a good agreement, though evidently better in the case of the prism-based cell model.     

An automatic approach for calibrating dielectric bone properties by combining finite-element and optimization software tools

The dielectric properties of human bone are one of the most essential inputs required by electromagnetic stimulation for improved bone regeneration. Measuring the electric properties of bone is a difficult task because of the complexity of the bone structure. Therefore, an automatic approach is presented to calibrate the electric properties of bone. The numerical method consists of three steps: generating input from experimental data, performing the numerical simulation, and calibrating the bone dielectric properties. As an example, the dielectric properties at 20 Hz of a rabbit distal femur were calibrated. The calibration process was considered as an optimization process with the aim of finding the optimum dielectric bone properties that match most of the numerically calculated simulation and experimentally measured data sets. The optimization was carried out automatically by the optimization software tool iSIGHT in combination with the finite-element solver COMSOL Multiphysics. As a result, the optimum conductivity and relative permittivity of the rabbit distal femur at 20 Hz were found to be 0.09615 S/m and 19522 for cortical bone and 0.14913 S/m and 1561507 for cancellous bone, respectively. The proposed method is a potential tool for the identification of realistic dielectric properties of the entire bone volume. The presented approach combining iSIGHT with COMSOL is applicable to, amongst others, designing implantable electro-stimulative devices or the optimization of electrical stimulation parameters for improved bone regeneration.     

Deterministic global optimization algorithm based on outer approximation for the parameter estima- tion of nonlinear dynamic biological systems

ABSTRACT: BACKGROUND: The estimation of parameter values for mathematical models of biological systems is an optimization problem that is particularly challenging due to the nonlinearities involved. One major difficulty is the existence of multiple minima in which standard optimization methods may fall during the search. Deterministic global optimization methods overcome this limitation, ensuring convergence to the global optimum within a desired tolerance. Global optimization techniques are typically classified into stochastic and deterministic. The former typically lead to lower CPU times but offer no guarantee of convergence to the global minimum in a finite number of iterations. In contrast, deterministic methods provide solutions of a given quality (i.e., optimality gap), but tend to lead to large computational burdens. RESULTS: This work presents a deterministic outer approximation-based algorithm for the global optimization of dynamic problems arising in the parameter estimation of models of biological systems. Our approach, which offers a theoretical guarantee of convergence to the global minimum, reformulating the set of ordinary differential equations into an equivalent set of algebraic equations through the use of orthogonal collocation methods, giving rise to a nonconvex nonlinear programming (NLP) problem. This nonconvex NLP is decomposed into two hierarchical levels: a master mixed-integer linear programming problem (MILP) that provides a rigorous lower bound on the optimal solution, and a reduced-space slave NLP that yields an upper bound. The algorithm iterates between these two levels until a termination criterion is satisfied. CONCLUSION: The capabilities of our approach were tested in two benchmark problems, in which the performance of our algorithm was compared with that of the commercial global optimization package BARON. The proposed strategy produced near optimal solutions (i.e., within a desired tolerance) in a fraction of the CPU time required by BARON.     

Application of the Elitist-Mutated PSO and an Improved GSA to Estimate Parameters of Linear and Nonlinear Muskingum Flood Routing Models

Heuristic search algorithms, which are characterized by faster convergence rates and can obtain better solutions than the traditional mathematical methods, are extensively used in engineering optimizations. In this paper, a newly developed elitist-mutated particle swarm optimization (EMPSO) technique and an improved gravitational search algorithm (IGSA) are successively applied to parameter estimation problems of Muskingum flood routing models. First, the global optimization performance of the EMPSO and IGSA are validated by nine standard benchmark functions. Then, to further analyse the applicability of the EMPSO and IGSA for various forms of Muskingum models, three typical structures are considered: the basic two-parameter linear Muskingum model (LMM), a three-parameter nonlinear Muskingum model (NLMM) and a four-parameter nonlinear Muskingum model which incorporates the lateral flow (NLMM-L). The problems are formulated as optimization procedures to minimize the sum of the squared deviations (SSQ) or the sum of the absolute deviations (SAD) between the observed and the estimated outflows. Comparative results of the selected numerical cases (Case 1–3) show that the EMPSO and IGSA not only rapidly converge but also obtain the same best optimal parameter vector in every run. The EMPSO and IGSA exhibit superior robustness and provide two efficient alternative approaches that can be confidently employed to estimate the parameters of both linear and nonlinear Muskingum models in engineering applications.     

Development and validation of evolutionary algorithm software as an optimization tool for biological and environmental applications

A flexible, extendable tool for the optimization of (micro)biological processes and protocols using evolutionary algorithms was developed. It has been tested using three different theoretical optimization problems: 2 two-dimensional problems, one with three maxima and one with five maxima and a river autopurification optimization problem with boundary conditions. For each problem, different evolutionary parameter settings were used for the optimization. For each combination of evolutionary parameters, 15 generations were run 20 times. It has been shown that in all cases, the evolutionary algorithm gave rise to valuable results. Generally, the algorithms were able to detect the more stable sub-maximum even if there existed less stable maxima. The latter is, from a practical point of view, generally more desired. The most important factors influencing the convergence process were the parameter value randomization rate and distribution. The developed software, described in this work, is available for free.     

基于混合优化算法的经颅磁刺激线圈阵列设计

为了研究对经颅磁刺激激励线圈聚焦性能的优化,利用混合优化算法与CST软件的外部通信接口,建立优化的激励线圈模型。依据多信道线圈阵列方法,利用磁场叠加原理,对影响磁场分布的线圈可调参数进行分析,结合混合优化算法对可调参数进行优化。结果对比显示,经优化的线圈阵列有良好的磁聚焦性,其刺激强度与聚焦程度都有了不同程度提高。可用于改善TMS系统聚焦性能,实验有助于进一步探索全面优化激励线圈的空间结构。     

分子生态学重要概念——遗传距离及其测度的理论研究概况

综述了遗传距离的概念、背景,有关遗传距离的几种基本的突变模型以及和遗传距离有关的参量和几种常用统计量,指出在处理蛋白质数据、分子数据以及序列数据时,如何选择相应的统计量和可用的软件包,同时还着重指明了各种模型的假设前提,为处理实际的蛋白质或分子数据时选择合适的模型,和对数据的最终解释提供一些帮助。     

A self-organizing state-space-model approach for parameter estimation in hodgkin-huxley-type models of single neurons

Traditional approaches to the problem of parameter estimation in biophysical models of neurons and neural networks usually adopt a global search algorithm (for example, an evolutionary algorithm), often in combination with a local search method (such as gradient descent) in order to minimize the value of a cost function, which measures the discrepancy between various features of the available experimental data and model output. In this study, we approach the problem of parameter estimation in conductance-based models of single neurons from a different perspective. By adopting a hidden-dynamical-systems formalism, we expressed parameter estimation as an inference problem in these systems, which can then be tackled using a range of well-established statistical inference methods. The particular method we used was Kitagawa's self-organizing state-space model, which was applied on a number of Hodgkin-Huxley-type models using simulated or actual electrophysiological data. We showed that the algorithm can be used to estimate a large number of parameters, including maximal conductances, reversal potentials, kinetics of ionic currents, measurement and intrinsic noise, based on low-dimensional experimental data and sufficiently informative priors in the form of pre-defined constraints imposed on model parameters. The algorithm remained operational even when very noisy experimental data were used. Importantly, by combining the self-organizing state-space model with an adaptive sampling algorithm akin to the Covariance Matrix Adaptation Evolution Strategy, we achieved a significant reduction in the variance of parameter estimates. The algorithm did not require the explicit formulation of a cost function and it was straightforward to apply on compartmental models and multiple data sets. Overall, the proposed methodology is particularly suitable for resolving high-dimensional inference problems based on noisy electrophysiological data and, therefore, a potentially useful tool in the construction of biophysical neuron models.     

Global identifiability of latent class models with applications to diagnostic test accuracy studies: A Gröbner basis approach

Identifiability of statistical models is a fundamental regularity condition that is required for valid statistical inference. Investigation of model identifiability is mathematically challenging for complex models such as latent class models. Jones et al. used Goodman's technique to investigate the identifiability of latent class models with applications to diagnostic tests in the absence of a gold standard test. The tool they used was based on examining the singularity of the Jacobian or the Fisher information matrix, in order to obtain insights into local identifiability (ie, there exists a neighborhood of a parameter such that no other parameter in the neighborhood leads to the same probability distribution as the parameter). In this paper, we investigate a stronger condition: global identifiability (ie, no two parameters in the parameter space give rise to the same probability distribution), by introducing a powerful mathematical tool from computational algebra: the Gröbner basis. With several existing well-known examples, we argue that the Gröbner basis method is easy to implement and powerful to study global identifiability of latent class models, and is an attractive alternative to the information matrix analysis by Rothenberg and the Jacobian analysis by Goodman and Jones et al.     

Comparison of Parameters from Rhythmometric Models with Multiple Components on Hybrid Data

Population multiple components is a statistical tool useful for the analysis of time-dependent hybrid data. With a small number of parameters, it is possible to model and to predict the periodic behavior of a population. In this article, we propose two methods to compare among populations rhythmometric parameters obtained by multiple component analysis. The first is a parametric method based in the usual statistical techniques for comparison of mean vectors in multivariate normal populations. The method, through MANOVA analysis, allows comparison of the MESOR and amplitude-acrophase pair of each component among two or more populations. The second is a nonparametric method, based in bootstrap techniques, to compare parameters from two populations. This test allows one to compare the MESOR, the amplitude, and the acrophase of each fitted component, as well as the global amplitude, orthophase, and bathyphase estimated when all fitted components are harmonics of a fundamental period. The idea is to calculate a confidence interval for the difference of the parameters of interest. If this interval does not contain zero, it can be concluded that the parameters from the two models are different with high probability. An estimation of p-value for the corresponding test can also be calculated. Both methods are illustrated with an example, based on clinical data. The nonparametric test can also be applied to paired data, a special situation of great interest in practice. By the use of similar bootstrap techniques, we illustrate how to construct confidence intervals for any rhythmometric parameter estimated from population multiple components models, including the orthophase, bathyphase, and global amplitude. These tests for comparison of parameters among populations are a needed tool when modeling the nonsinusoidal rhythmic behavior of hybrid data by population multiple component analysis.     

Comparison of parameters from rhythmometric models with multiple components on hybrid data

Population multiple components is a statistical tool useful for the analysis of time-dependent hybrid data. With a small number of parameters, it is possible to model and to predict the periodic behavior of a population. In this article, we propose two methods to compare among populations rhythmometric parameters obtained by multiple component analysis. The first is a parametric method based in the usual statistical techniques for comparison of mean vectors in multivariate normal populations. The method, through MANOVA analysis, allows comparison of the MESOR and amplitude-acrophase pair of each component among two or more populations. The second is a nonparametric method, based in bootstrap techniques, to compare parameters from two populations. This test allows one to compare the MESOR, the amplitude, and the acrophase of each fitted component, as well as the global amplitude, orthophase, and bathyphase estimated when all fitted components are harmonics of a fundamental period. The idea is to calculate a confidence interval for the difference of the parameters of interest. If this interval does not contain zero, it can be concluded that the parameters from the two models are different with high probability. An estimation of p-value for the corresponding test can also be calculated. Both methods are illustrated with an example, based on clinical data. The nonparametric test can also be applied to paired data, a special situation of great interest in practice. By the use of similar bootstrap techniques, we illustrate how to construct confidence intervals for any rhythmometric parameter estimated from population multiple components models, including the orthophase, bathyphase, and global amplitude. These tests for comparison of parameters among populations are a needed tool when modeling the nonsinusoidal rhythmic behavior of hybrid data by population multiple component analysis.     

The use of non-linear regression analysis and the F test for model discrimination with dose-response curves and ligand binding data

Computer fitting of binding data is discussed and it is concluded that the main problem is the choice of starting estimates and internal scaling parameters, not the optimization software. Solving linear overdetermined systems of equations for starting estimates is investigated. A function, Q, is introduced to study model discrimination with binding isotherms and the behaviour of Q as a function of model parameters is calculated for the case of 2 and 3 sites. The power function of the F test is estimated for models with 2 to 5 binding sites and necessary constraints on parameters for correct model discrimination are given. The sampling distribution of F test statistics is compared to an exact F distribution using the Chi-squared and Kolmogorov-Smirnov tests. For low order modes (n less than 3) the F test statistics are approximately F distributed but for higher order models the test statistics are skewed to the left of the F distribution. The parameter covariance matrix obtained by inverting the Hessian matrix of the objective function is shown to be a good approximation to the estimate obtained by Monte Carlo sampling for low order models (n less than 3). It is concluded that analysis of up to 2 or 3 binding sites presents few problems and linear, normal statistical results are valid. To identify correctly 4 sites is much more difficult, requiring very precise data and extreme parameter values. Discrimination of 5 from 4 sites is an upper limit to the usefulness of the F test.