React or wait: which optimal culling strategy to control infectious diseases in wildlife

We applied optimal control theory to an SI epidemic model to identify optimal culling strategies for diseases management in wildlife. We focused on different forms of the objective function, including linear control, quadratic control, and control with limited amount of resources. Moreover, we identified optimal solutions under different assumptions on disease-free host dynamics, namely: self-regulating logistic growth, Malthusian growth, and the case of negligible demography. We showed that the correct characterization of the disease-free host growth is crucial for defining optimal disease control strategies. By analytical investigations of the model with negligible demography, we demonstrated that the optimal strategy for the linear control can be either to cull at the maximum rate at the very beginning of the epidemic (reactive culling) when the culling cost is low, or never to cull, when culling cost is high. On the other hand, in the cases of quadratic control or limited resources, we demonstrated that the optimal strategy is always reactive. Numerical analyses for hosts with logistic growth showed that, in the case of linear control, the optimal strategy is always reactive when culling cost is low. In contrast, if the culling cost is high, the optimal strategy is to delay control, i.e. not to cull at the onset of the epidemic. Finally, we showed that for diseases with the same basic reproduction number delayed control can be optimal for acute infections, i.e. characterized by high disease-induced mortality and fast dynamics, while reactive control can be optimal for chronic ones.     

Optimal risk management of human alveolar echinococcosis with vermifuge

In this study, we develop a bioeconomic model of human alveolar echinococcosis (HAE) and formulate the optimal strategies for managing the infection risks in humans by applying optimal control theory. The model has the following novel features: (i) the complex transmission cycle of HAE has been tractably incorporated into the framework of optimal control problems and (ii) the volume of vermifuge spreading to manage the risk is considered a control variable. With this model, we first obtain the stability conditions for the transmission dynamics under the condition of constant control. Second, we explicitly introduce a control variable of vermifuge spreading into the analysis by considering the associated control costs. In this optimal control problem, we have successfully derived a set of conditions for a bang-bang control and singular control, which are mainly characterized by the prevalence of infection in voles and foxes and the remaining time of control. The analytical results are demonstrated by numerical analysis and we discuss the effects of the parameter values on the optimal strategy and the transmission cycle. We find that when the prevalence of infection in foxes is low and the prevalence of infection in voles is sufficiently high, the optimal strategy is to expend no effort in vermifuge spreading.     

Chemotherapy for tumors: an analysis of the dynamics and a study of quadratic and linear optimal controls

We investigate a mathematical model of tumor-immune interactions with chemotherapy, and strategies for optimally administering treatment. In this paper we analyze the dynamics of this model, characterize the optimal controls related to drug therapy, and discuss numerical results of the optimal strategies. The form of the model allows us to test and compare various optimal control strategies, including a quadratic control, a linear control, and a state-constraint. We establish the existence of the optimal control, and solve for the control in both the quadratic and linear case. In the linear control case, we show that we cannot rule out the possibility of a singular control. An interesting aspect of this paper is that we provide a graphical representation of regions on which the singular control is optimal.     

Optimal Vaccination Policies for an SIR Model with Limited Resources

The purpose of the paper is to use analytical method and optimization tool to suggest a vaccination program intensity for a basic SIR epidemic model with limited resources for vaccination. We show that there are two different scenarios for optimal vaccination strategies, and obtain analytical solutions for the optimal control problem that minimizes the total cost of disease under the assumption of daily vaccine supply being limited. These solutions and their corresponding optimal control policies are derived explicitly in terms of initial conditions, model parameters and resources for vaccination. With sufficient resources, the optimal control strategy is the normal Bang–Bang control. However, with limited resources, the optimal control strategy requires to switch to time-variant vaccination.     

Genetic algorithms with filters for optimal control problems in fed-batch bioreactors

When using a genetic algorithm (GA) to solve optimal control problems that can arise in a fed-batch bioreactor, the most obvious direct approach is to rely on a finite dimensional discretization of the optimal control problem into a nonlinear programming problem. Usually only the control function is discretized, and the continuous control function is approximated by a series of piecewise constant functions. Even though the piecewise discretized controls that the GA produces for the optimal control problem may give good performances, the control policies often show very high activity and differ considerably from those obtained using a continuous optimization strategy. The present study introduces a few filters into a real-coded genetic algorithm as additional operators and investigates the smoothing capabilities of the filters employed. It is observed that inclusion of a filter significantly smoothens the optimal control profile and often encourages the convergence of the algorithm. The applicability of the technique is illustrated by solving two previously reported optimal control problems in fed-batch bioreactors that are known to have singular arcs.     

Optimal control of epidemics with limited resources

We extend the existing work on the time-optimal control of the basic SIR epidemic model with mass action contact rate. Previous results have focused on minimizing an objective function that is a linear combination of the cost associated with using control and either the outbreak size or the infectious burden. We instead, provide analytic solutions for the control that minimizes the outbreak size (or infectious burden) under the assumption that there are limited control resources. We provide optimal control policies for an isolation only model, a vaccination only model and a combined isolation–vaccination model (or mixed model). The optimal policies described here contain many interesting features especially when compared to previous analyses. For example, under certain circumstances the optimal isolation only policy is not unique. Furthermore the optimal mixed policy is not simply a combination of the optimal isolation only policy and the optimal vaccination only policy. The results presented here also highlight a number of areas that warrant further study and emphasize that time-optimal control of the basic SIR model is still not fully understood.     

Optimal coordination and control of posture and locomotion.

This paper presents a theoretical model of stability and coordination of posture and locomotion, together with algorithms for continuous-time quadratic optimization of motion control. Explicit solutions to the Hamilton-Jacobi equation for optimal control of rigid-body motion are obtained by solving an algebraic matrix equation. The stability is investigated with Lyapunov function theory, and it is shown that global asymptotic stability holds. It is also shown how optimal control and adaptive control may act in concert in the case of unknown or uncertain system parameters. The solution describes motion strategies of minimum effort and variance. The proposed optimal control is formulated to be suitable as a posture and stance model for experimental validation and verification. The combination of adaptive and optimal control makes this algorithm a candidate for coordination and control of functional neuromuscular stimulation as well as of prostheses.     

The numerical method for the optimal supporting position and related optimal control for the catalytic reaction system

This paper considers the numerical approximation for the optimal supporting position and related optimal control of a catalytic reaction system with some control and state constraints, which is governed by a nonlinear partial differential equations with given initial and boundary conditions. By the Galerkin finite element method, the original problem is projected into a semi-discrete optimal control problem governed by a system of ordinary differential equations. Then the control parameterization method is applied to approximate the control and reduce the original system to an optimal parameter selection problem, in which both the position and related control are taken as decision variables to be optimized. This problem can be solved as a nonlinear optimization problem by a particle swarm optimization algorithm. The numerical simulations are given to illustrate the effectiveness of the proposed numerical approximation method.     

On boundary stimulation and optimal boundary control of the bidomain equations

The bidomain equations with Neumann boundary stimulation and optimal control of these stimuli are investigated. First an analytical framework for boundary control is provided. Then a parallel finite element based algorithm is devised and its efficiency is demonstrated not only for the direct problem but also for the optimal control problem. The computations realize a model configuration corresponding to optimal boundary defibrillation of a reentry phenomenon by applying current density stimuli.     

Optimal coordination and control of posture and movements

This paper presents a theoretical model of stability and coordination of posture and locomotion, together with algorithms for continuous-time quadratic optimization of motion control. Explicit solutions to the Hamilton–Jacobi equation for optimal control of rigid-body motion are obtained by solving an algebraic matrix equation. The stability is investigated with Lyapunov function theory and it is shown that global asymptotic stability holds. It is also shown how optimal control and adaptive control may act in concert in the case of unknown or uncertain system parameters. The solution describes motion strategies of minimum effort and variance. The proposed optimal control is formulated to be suitable as a posture and movement model for experimental validation and verification. The combination of adaptive and optimal control makes this algorithm a candidate for coordination and control of functional neuromuscular stimulation as well as of prostheses. Validation examples with experimental data are provided.     

A parameter optimization approach for the optimal control of large-scale musculoskeletal systems.

This paper describes a computational method for solving optimal control problems involving large-scale, nonlinear, dynamical systems. Central to the approach is the idea that any optimal control problem can be converted into a standard nonlinear programming problem by parameterizing each control history using a set of nodal points, which then become the variables in the resulting parameter optimization problem. A key feature of the method is that it dispenses with the need to solve the two-point, boundary-value problem derived from the necessary conditions of optimal control theory. Gradient-based methods for solving such problems do not always converge due to computational errors introduced by the highly nonlinear characteristics of the costate variables. Instead, by converting the optimal control problem into a parameter optimization problem, any number of well-developed and proven nonlinear programming algorithms can be used to compute the near-optimal control trajectories. The utility of the parameter optimization approach for solving general optimal control problems for human movement is demonstrated by applying it to a detailed optimal control model for maximum-height human jumping. The validity of the near-optimal control solution is established by comparing it to a solution of the two-point, boundary-value problem derived on the basis of a bang-bang optimal control algorithm. Quantitative comparisons between model and experiment further show that the parameter optimization solution reproduces the major features of a maximum-height, countermovement jump (i.e., trajectories of body-segmental displacements, vertical and fore-aft ground reaction forces, displacement, velocity, and acceleration of the whole-body center of mass, pattern of lower-extremity muscular activity, jump height, and total ground contact time).     

微生物连续培养模型的最优溢流量控制

本文使用最优控制理论研究了微生物连续培养模型的最优溢流量控制问题,导出了一种关于微生物浓度的线性反馈控制律．在该控制律下,可保证微生物连续培养模型能跟踪理想微生物浓度ｘｄ．     

Combined harvesting of a stage structured prey–predator model incorporating cannibalism in competitive environment

In this paper, we propose a prey–predator system with stage structure for predator. The proposed system incorporates cannibalism for predator populations in a competitive environment. The combined fishing effort is considered as control used to harvest the populations. The steady states of the system are determined and the dynamical behavior of the system is discussed. Local stability of the system is analyzed and sufficient conditions are derived for the global stability of the system at the positive equilibrium point. The existence of the Hopf bifurcation phenomenon is examined at the positive equilibrium point of the proposed system. We consider harvesting effort as a control parameter and subsequently, characterize the optimal control parameter in order to formulate the optimal control problem under the dynamic framework towards optimal utilization of the resource. Moreover, the optimal system is solved numerically to investigate the sustainability of the ecosystem using an iterative method with a Runge–Kutta fourth-order scheme. Simulation results show that the optimal control scheme can achieve sustainable ecosystem. Results are analyzed with the help of graphical illustrations.     

Pontryagin's principle for control problems in age-dependent population dynamics

In this paper, Pontryagin's principle is proved for a fairly general problem of optimal control of populations with continuous time and age variable. As a consequence, maximum principles are developed for an optimal harvesting problem and a problem of optimal birth control.     

What is optimal about motor control?

This article poses a controversial question: is optimal control theory useful for understanding motor behavior or is it a misdirection? This question is becoming acute as people start to conflate internal models in motor control and perception (Poeppel et?al., 2008; Hickok et?al., 2011). However, the forward models in motor control are not the generative models used in perceptual inference. This Perspective tries to highlight the differences between internal models in motor control and perception and asks whether optimal control is the right way to think about things. The issues considered here may have broader implications for optimal decision theory and Bayesian approaches to learning and behavior in general.     

An integrated scheduling and control model for multi-mode projects

In today’s highly competitive uncertain project environments, it is of crucial importance to develop analytical models and algorithms to schedule and control project activities so that the deviations from the project objectives are minimized. This paper addresses the integrated scheduling and control in multi-mode project environments. We propose an optimization model that models the dynamic behavior of projects and integrates optimal control into a practically relevant project scheduling problem. From the scheduling perspective, we address the discrete time/cost trade-off problem, whereas an optimal control formulation is used to capture the effect of project control. Moreover, we develop a solution algorithm for two particular instances of the optimal project control. This algorithm combines a tabu search strategy and nonlinear programming. It is applied to a large scale test bed and its efficiency is tested by means of computational experiments. To the best of our knowledge, this research is the first application of optimal control theory to multi-mode project networks. The models and algorithms developed in this research are targeted as a support tool for project managers in both scheduling and deciding on the timing and quantity of control activities.     

Discrete-time host-parasitoid models with pest control

We propose a simple discrete-time host-parasitoid model to investigate the impact of external input of parasitoids upon the host-parasitoid interactions. It is proved that the input of the external parasitoids can eventually eliminate the host population if it is above a threshold and it also decreases the host population level in the unique interior equilibrium. It can simplify the host-parasitoid dynamics when the host population practices contest competition. We then consider a corresponding optimal control problem over a finite time period. We also derive an optimal control model using a chemical as a control for the hosts. Applying the forward-backward sweep method, we solve the optimal control problems numerically and compare the optimal host populations with the host populations when no control is applied. Our study concludes that applying a chemical to eliminate the hosts directly may be a more effective control strategy than using the parasitoids to indirectly suppress the hosts.     

Optimal isn’t good enough

The notion that biological systems come to embody optimal solutions seems consistent with the competitive drive of evolution. It has been used to interpret many examples of sensorimotor behavior. It is attractive from the viewpoint of control engineers because it solves the redundancy problem by identifying the one optimal motor strategy out of many similarly acceptable possibilities. This perspective examines whether there is sufficient basis to apply the formal engineering tools of optimal control to a reductionist understanding of biological systems. For an experimental biologist, this translates into whether the theory of optimal control generates nontrivial and testable hypotheses that accurately predict novel phenomena, ideally at deeper levels of structure than the observable behavior. The methodology of optimal control is applicable when there is (i) a single, known cost function to be optimized, (ii) an invertible model of the plant, and (iii) simple noise interfering with optimal performance. None of these is likely to be true for biological organisms. Furthermore, their motivation is usually good-enough rather than globally optimal behavior. Even then, the performance of a biological organism is often much farther from optimal than the physical limits of its hardware because the brain is continuously testing the acceptable limits of performance as well as just performing the task. This perspective considers an alternative strategy called ??good-enough?? control, in which the organism uses trial-and-error learning to acquire a repertoire of sensorimotor behaviors that are known to be useful, but not necessarily optimal. This leads to a diversity of solutions that tends to confer robustness on the individual organism and its evolution. It is also more consistent with the capabilities of higher sensorimotor structures, such as cerebral cortex, which seems to be designed to classify and recall complex sets of information, thereby allowing the organism to learn from experience, rather than to compute new strategies online. Optimal control has been a useful metaphor for understanding some superficial aspects of motor psychophysics. Reductionists who want to understand the underlying neural mechanisms need to move on.     

A nonsingular optimization approach to the feed rate profile optimization of fedbatch cultures

A new method to calculate the optimal feed rate profile for fedbatch culture is proposed. Instead of the usual singular control approach of taking the feed rate as the control variable, the substrate concentration profile is used as the transformed control variable to avoid the computational difficulty associated with the singular control. Thus, the problem is converted into a nonsingular optimization problem of determining the optimal substrate concentration profile subject to a constraint. The equivalent feed rate profile to match the optimal substrate concentration profile is then generated. With this method the computational difficulty associated with singular controls for high-order systems is circumvented. The proposed method is illustrated by a number of examples.     

年龄相关的种群系统的最优生育率控制

讨论了一类与年龄相关的时变种群系统最优生育率控制的非线性问题,利用Ba- nach空间的Saks-Masur引理,证明了系统最优生育率控制的存在唯一性,并得到了控制为最优的必要条件和最优性组．所得结果可为种群系统控制问题的实际研究提供必要的数学理论基础．