Online nonlinear sequential Bayesian estimation of a biological wastewater treatment process

Online estimation of unknown state variables is a key component in the accurate modelling of biological wastewater treatment processes due to a lack of reliable online measurement systems. The extended Kalman filter (EKF) algorithm has been widely applied for wastewater treatment processes. However, the series approximations in the EKF algorithm are not valid, because biological wastewater treatment processes are highly nonlinear with a time-varying characteristic. This work proposes an alternative online estimation approach using the sequential Monte Carlo (SMC) methods for recursive online state estimation of a biological sequencing batch reactor for wastewater treatment. SMC is an algorithm that makes it possible to recursively construct the posterior probability density of the state variables, with respect to all available measurements, through a random exploration of the states by entities called ‘particle’. In this work, the simplified and modified Activated Sludge Model No. 3 with nonlinear biological kinetic models is used as a process model and formulated in a dynamic state-space model applied to the SMC method. The performance of the SMC method for online state estimation applied to a biological sequencing batch reactor with online and offline measured data is encouraging. The results indicate that the SMC method could emerge as a powerful tool for solving online state and parameter estimation problems without any model linearization or restrictive assumptions pertaining to the type of nonlinear models for biological wastewater treatment processes.     

An Extended Kalman Filtering Approach to Modeling Nonlinear Dynamic Gene Regulatory Networks via Short Gene Expression Time Series

In this paper, the extended Kalman filter (EKF) algorithm is applied to model the gene regulatory network from gene time series data. The gene regulatory network is considered as a nonlinear dynamic stochastic model that consists of the gene measurement equation and the gene regulation equation. After specifying the model structure, we apply the EKF algorithm for identifying both the model parameters and the actual value of gene expression levels. It is shown that the EKF algorithm is an online estimation algorithm that can identify a large number of parameters (including parameters of nonlinear functions) through iterative procedure by using a small number of observations. Four real-world gene expression data sets are employed to demonstrate the effectiveness of the EKF algorithm, and the obtained models are evaluated from the viewpoint of bioinformatics.     

Joint estimation in batch culture by using unscented kalman filter

The disturbances caused by uncertain factors are inevitable in microbial fermentation. In this paper, we study the joint estimation problem for state and parameter in the bio-dissimulation process of glycerol to 1,3-PD in batch culture. Based on the nonlinear stochastic dynamic system model, we establish the corresponding iteration equations of Joint Unscented Kalman Filter (UKF) by referring to the Extended Kalman Filter (EKF), which is generally applied in microbial fermentation. Through numerical computation, both the state estimations and the uncertain model parameter estimations are obtained. Furthermore, the results of different parameter identification methods are compared. The results show that Joint UKF is more feasible for the process of controlling the glycerol fermentation.     

A neurally plausible model of the dynamics of motion integration in smooth eye pursuit based on recursive Bayesian estimation

In this study, we describe a model of motion integration in smooth eye pursuit based on a recursive Bayesian estimation process, which displays a dynamic behaviour qualitatively similar to the dynamics of the motion integration process observed experimentally, both psychophysically in humans and monkeys, and physiologically in monkeys. By formulating the model as an approximate version of a Kalman filter algorithm, we have been able to show that it can be put into a neurally plausible, distributed recurrent form which coarsely corresponds to the recurrent circuitry of visual cortical areas V1 and MT. The model thus provides further support for the notion that the motion integration process is based on a form of Bayesian estimation, as has been suggested by many psychophysical studies, and moreover suggests that the observed dynamic properties of this process are the result of the recursive nature of the motion estimation.     

Extended Kalman Filter for Estimation of Parameters in Nonlinear State-Space Models of Biochemical Networks

It is system dynamics that determines the function of cells, tissues and organisms. To develop mathematical models and estimate their parameters are an essential issue for studying dynamic behaviors of biological systems which include metabolic networks, genetic regulatory networks and signal transduction pathways, under perturbation of external stimuli. In general, biological dynamic systems are partially observed. Therefore, a natural way to model dynamic biological systems is to employ nonlinear state-space equations. Although statistical methods for parameter estimation of linear models in biological dynamic systems have been developed intensively in the recent years, the estimation of both states and parameters of nonlinear dynamic systems remains a challenging task. In this report, we apply extended Kalman Filter (EKF) to the estimation of both states and parameters of nonlinear state-space models. To evaluate the performance of the EKF for parameter estimation, we apply the EKF to a simulation dataset and two real datasets: JAK-STAT signal transduction pathway and Ras/Raf/MEK/ERK signaling transduction pathways datasets. The preliminary results show that EKF can accurately estimate the parameters and predict states in nonlinear state-space equations for modeling dynamic biochemical networks.     

Parameter Estimation and Model Selection in Computational Biology

A central challenge in computational modeling of biological systems is the determination of the model parameters. Typically, only a fraction of the parameters (such as kinetic rate constants) are experimentally measured, while the rest are often fitted. The fitting process is usually based on experimental time course measurements of observables, which are used to assign parameter values that minimize some measure of the error between these measurements and the corresponding model prediction. The measurements, which can come from immunoblotting assays, fluorescent markers, etc., tend to be very noisy and taken at a limited number of time points. In this work we present a new approach to the problem of parameter selection of biological models. We show how one can use a dynamic recursive estimator, known as extended Kalman filter, to arrive at estimates of the model parameters. The proposed method follows. First, we use a variation of the Kalman filter that is particularly well suited to biological applications to obtain a first guess for the unknown parameters. Secondly, we employ an a posteriori identifiability test to check the reliability of the estimates. Finally, we solve an optimization problem to refine the first guess in case it should not be accurate enough. The final estimates are guaranteed to be statistically consistent with the measurements. Furthermore, we show how the same tools can be used to discriminate among alternate models of the same biological process. We demonstrate these ideas by applying our methods to two examples, namely a model of the heat shock response in E. coli, and a model of a synthetic gene regulation system. The methods presented are quite general and may be applied to a wide class of biological systems where noisy measurements are used for parameter estimation or model selection.     

The Unscented Kalman Filter estimates the plasma insulin from glucose measurement

Understanding the simultaneous interaction within the glucose and insulin homeostasis in real-time is very important for clinical treatment as well as for research issues. Until now only plasma glucose concentrations can be measured in real-time. To support a secure, effective and rapid treatment e.g. of diabetes a real-time estimation of plasma insulin would be of great value. A novel approach using an Unscented Kalman Filter that provides an estimate of the current plasma insulin concentration is presented, which operates on the measurement of the plasma glucose and Bergman's Minimal Model of the glucose insulin homeostasis. We can prove that process observability is obtained in this case. Hence, a successful estimator design is possible. Since the process is nonlinear we have to consider estimates that are not normally distributed. The symmetric Unscented Kalman Filter (UKF) will perform best compared to other estimator approaches as the Extended Kalman Filter (EKF), the simplex Unscented Kalman Filter (UKF), and the Particle Filter (PF). The symmetric UKF algorithm is applied to the plasma insulin estimation. It shows better results compared to the direct (open loop) estimation that uses a model of the insulin subsystem.     

Dynamic metabolic flux analysis (DMFA): a framework for determining fluxes at metabolic non-steady state

Metabolic flux analysis (MFA) is a key tool for measuring in vivo metabolic fluxes in systems at metabolic steady state. Here, we present a new method for dynamic metabolic flux analysis (DMFA) of systems that are not at metabolic steady state. The advantages of our DMFA method are: (1) time-series of metabolite concentration data can be applied directly for estimating dynamic fluxes, making data smoothing and estimation of average extracellular rates unnecessary; (2) flux estimation is achieved without integration of ODEs, or iterations; (3) characteristic metabolic phases in the fermentation data are identified automatically by the algorithm, rather than selected manually/arbitrarily. We demonstrate the application of the new DMFA framework in three example systems. First, we evaluated the performance of DMFA in a simple three-reaction model in terms of accuracy, precision and flux observability. Next, we analyzed a commercial glucose-limited fed-batch process for 1,3-propanediol production. The DMFA method accurately captured the dynamic behavior of the fed-batch fermentation and identified characteristic metabolic phases. Lastly, we demonstrate that DMFA can be used without any assumed metabolic network model for data reconciliation and detection of gross measurement errors using carbon and electron balances as constraints.     

State estimation of a Uricase production process with Candida Utilis

The present work discusses the implementation of a Kalman filtering procedure in a state estimation of a batch Uricase production process with Candida Utilis. An unstructured model of the process is used for the estimation procedure. The observability is thoroughly investigated and a Kalman filter is applied afterwards as a powerful and precise state estimation tool. The estimates in all cases of observability are presented, compared and discussed.     

RankAggreg, an R package for weighted rank aggregation

Background

Determining the parameters of a mathematical model from quantitative measurements is the main bottleneck of modelling biological systems. Parameter values can be estimated from steady-state data or from dynamic data. The nature of suitable data for these two types of estimation is rather different. For instance, estimations of parameter values in pathway models, such as kinetic orders, rate constants, flux control coefficients or elasticities, from steady-state data are generally based on experiments that measure how a biochemical system responds to small perturbations around the steady state. In contrast, parameter estimation from dynamic data requires time series measurements for all dependent variables. Almost no literature has so far discussed the combined use of both steady-state and transient data for estimating parameter values of biochemical systems.

Results

In this study we introduce a constrained optimization method for estimating parameter values of biochemical pathway models using steady-state information and transient measurements. The constraints are derived from the flux connectivity relationships of the system at the steady state. Two case studies demonstrate the estimation results with and without flux connectivity constraints. The unconstrained optimal estimates from dynamic data may fit the experiments well, but they do not necessarily maintain the connectivity relationships. As a consequence, individual fluxes may be misrepresented, which may cause problems in later extrapolations. By contrast, the constrained estimation accounting for flux connectivity information reduces this misrepresentation and thereby yields improved model parameters.

Conclusion

The method combines transient metabolic profiles and steady-state information and leads to the formulation of an inverse parameter estimation task as a constrained optimization problem. Parameter estimation and model selection are simultaneously carried out on the constrained optimization problem and yield realistic model parameters that are more likely to hold up in extrapolations with the model.     

A local training and pruning approach for neural networks

The training of neural networks using the extended Kalman filter (EKF) algorithm is plagued by the drawback of high computational complexity and storage requirement that may become prohibitive even for networks of moderate size. In this paper, we present a local EKF training and pruning approach that can solve this problem. In particular, the by-products obtained along with the local EKF training can be utilized to measure the importance of the network weights. Comparing with the original global approach, the proposed local EKF training and pruning approach results in a much lower computational complexity and storage requirement. Hence, it is more practical in solving real world problems. The performance of the proposed algorithm is demonstrated on one medium- and one large-scale problems, namely, sunspot data prediction and handwritten digit recognition.     

State and parameter estimation of microalgal photobioreactor cultures based on local irradiance measurement

Local photosynthetic photon flux fluence rate (PPFFR) determined by a submersible 4pi quantum micro-sensor was used in developing a versatile on-line state estimator for stirred-tank microalgal photobioreactor cultures. A marine micro-alga Dunaliella salina was used as a model organism in this study. On-line state estimation was realized using the extended Kalman filter (EKF), based on a state model of the photobioreactor and on-line local PPFFR measurement. The dynamic state model for the photobioreactor was derived based on mass-balance equations of the relevant states. The measurement equation was established based on an empirical correlation between the microalgal biomass concentration and the local PPFFR measured at a fixed point inside the photobioreactor. An internal model approach was used to estimate the specific growth rate without the need of state-based kinetic expression. The estimator was proven to be capable of estimating biomass concentration and specific growth rate, as well as phosphate and dissolved oxygen concentrations in a photobioreactor illuminated with either fixed or time-varying incident radiation. The quantum sensor was shown to be robust and able to quickly respond to dynamic changes in local PPFFR. In addition, the quantum sensor outputs were not affected by bubble aeration or agitation within the typical operating range. The strong filtering capacity of EKF gives the state estimator superior performance compared to direct calculation from the empirical biomass/local PPFFR correlation. This state estimation system makes use of inexpensive and reliable sensor hardware to report key process dynamics of microalgal photobioreactor cultures on-line, enabling improved operation of such a process.     

An algorithmic approach to constructing the on-line estimation system for the specific growth rate

The objective of this article is to propose an algorithm for the on-line estimation of the specific growth rate in a batch or a fed-batch fermentation process. The algorithm shows the practical procedure for the estimation method utilizing the macroscopic balance and the extended Kalman filter. A number of studies of the on line estimation have been presented. However, there are few studies discussing about the selection of the observed variables and for the tuning of some parameters of the extended Kalman filter, such as covariance matrix and initial values of the state.The beginning of this article is devoted to explain the selection of the observed variable. This information is very important in terms of the practical know-how for using technique. It is discovered that the condition number is a practically useful and valid criterion for number is a practically useful and valid criterion for choosing the variable to be observed.Next, when the extended Kalman filter in applied to the online estimation of the specific growth rate, which is directly unmeasurable, criteria for judging the validity of the estimated value from the observed data are proposed. Based on the proposed criterial, the system equation of the specific growth rate is selected and initial value of the state variable and covariance matrix of the system noises are adjusted. From many experiments, it is certified that the specific growth rate in the batch or fed -batch fermentation can be estimated accurately by means of the algorithm proposed here. In these experiments, that is, when the cell concentration is measured directly, the extended Kalman filter using the convariance matrix with a constant element can estimate more accurately values of the specific growth rate than the adaptive extended Kalman filter does.     

Using an extended kalman filter for rigid body pose estimation

Rigid body pose is commonly represented as the rigid body transformation from one (often reference) pose to another This is usually computed for each frame of data without any assumptions or restrictions on the temporal change of the pose. The most common algorithm was proposed by S?derkvist and Wedin (1993, "Determining the Movements of the Skeleton Using Well-configured Markers," J. Biomech., 26, pp. 1473-1477), and implies the assumption that measurement errors are isotropic and homogenous. This paper describes an alternative method based on a state space formulation and the application of an extended Kalman filter (EKF). State space models are formulated, which describe the kinematics of the rigid body. The state vector consists of six generalized coordinates (corresponding to the 6 degrees of freedom), and their first time derivatives. The state space models have linear dynamics, while the measurement function is a non-linear relation between the state vector and the observations (marker positions). An analytical expression for the linearized measurement function is derived. Tracking the rigid body motion using an EKF enables the use of a priori information on the measurement noise and type of motion to tune the filter. The EKF is time variant, which allows for a natural way of handling temporarily missing marker data. State updates are based on all the information available at each time step, even when data from fewer than three markers are available. Comparison with the method of S?derkvist and Wedin on simulated data showed a considerable improvement in accuracy with the proposed EKF method when marker data was temporarily missing. The proposed method offers an improvement in accuracy of rigid body pose estimation by incorporating knowledge of the characteristics of the movement and the measurement errors. Analytical expressions for the linearized system equations are provided, which eliminate the need for approximate discrete differentiation and which facilitate a fast implementation.     

The natural frequency of the foot-surface cushion during the stance phase of running

Researchers have reported on the stiffness of running in holistic terms, i.e. for the structures that are undergoing deformation as a whole rather than in terms of specific locations. This study aimed to estimate both the natural frequency and the viscous damping coefficient of the human foot-surface cushion, during the period between the heel strike and the mid-stance phase of running, using a purposely developed one degree-of-freedom inverted pendulum state space model of the leg. The model, which was validated via a comparison of measured and estimated ground reaction forces, incorporated a novel use of linearized and extended Kalman filter estimators. Investigation of the effect of variation of the natural frequency and/or the damping of the cushioning mechanism during running, using the said model, revealed the natural frequency of running on said foot-surface cushion, during the stance phase, to lie between 5 and 11 Hz. The "extended Kalman filter (EKF)" approach, that was used here for the first time to directly apply measured ground forces, may be widely applicable to the identification process of combined estimation of both unknown physiological state and mechanical characteristics of the environment in an inverse dynamic model.     

Recursive on-line estimation of the specific growth rate from off-gas analysis for the adaptive control of fed-batch processes

A recursive estimation algorithm for the specific growth rate of aerobic fed-batch processes was developed. The estimate (t) is independent of the state estimates X(t) of the process. This improves the stability of the closed loop system. The performance of the nonlinear control system was tested on fermentations with streptomyces tendae with great success. The methodology of the nonlinear control system is very general. Thus, it can be applied to substrate control problems of any other aerobic fed-batch process.     

Analysis of Video-Based Microscopic Particle Trajectories Using Kalman Filtering

The fidelity of the trajectories obtained from video-based particle tracking determines the success of a variety of biophysical techniques, including in situ single cell particle tracking and in vitro motility assays. However, the image acquisition process is complicated by system noise, which causes positioning error in the trajectories derived from image analysis. Here, we explore the possibility of reducing the positioning error by the application of a Kalman filter, a powerful algorithm to estimate the state of a linear dynamic system from noisy measurements. We show that the optimal Kalman filter parameters can be determined in an appropriate experimental setting, and that the Kalman filter can markedly reduce the positioning error while retaining the intrinsic fluctuations of the dynamic process. We believe the Kalman filter can potentially serve as a powerful tool to infer a trajectory of ultra-high fidelity from noisy images, revealing the details of dynamic cellular processes.