The mathematical concept of multiplier robust control is applied to a dam operation problem, which is an urgent issue on river water environment, as a new industrial application of stochastic optimal control. The goal...
详细信息
The mathematical concept of multiplier robust control is applied to a dam operation problem, which is an urgent issue on river water environment, as a new industrial application of stochastic optimal control. The goal of the problem is to find a fit-for-purpose and environmentally sound operation policy of the flow discharge from a dam so that overgrowth of the harmful algae Cladophora glomerataKutzing in its downstream river is effectively suppressed. A minimal stochastic differential equation for the algae growth dynamics with uncertain growth rate is first presented. The performance index to be maximized by the operator of the dam while minimized by nature is formulated within the framework of differential games. The dynamic programming principle leads to a Hamilton-Jacobi-Bellman-Isaacs equation whose solution determines the worst-case optimal operation policy of the dam, ie, the policy that the operator wants to find. Application of the model to overgrowth suppression of Cladophora glomerataKutzing just downstream of a dam in a Japanese river is then carried out. Values of the model parameters are identified with which the model successfully reproduces the observed population dynamics. A series of numerical experiments are performed to find the most effective operation policy of the dam based on a relaxation of the current policy.
We analyze an optimal stopping problem sup(gamma is an element of T) (xi) over bar 0[y(gamma Lambda tau 0)] with random maturity to under a nonlinear expectation (xi) over bar0[.] := sup(P is an element of P) Eg[.], w...
详细信息
We analyze an optimal stopping problem sup(gamma is an element of T) (xi) over bar 0[y(gamma Lambda tau 0)] with random maturity to under a nonlinear expectation (xi) over bar0[.] := sup(P is an element of P) Eg[.], where P is a weakly compact set of mutually singular probabilities. The maturity tau(0) is specified as the hitting time to level 0 of some continuous index process X at which the payoff process g is even allowed to have a positive jump. When P collects a variety of semimartingale measures, the optimal stopping problem can be viewed as a discretionary stopping problem for a player who can influence both drift and volatility of the dynamic of underlying stochastic flow. We utilize a martingale approach to construct an optimal pair (P-*, y(*)) for sup((P, gamma)is an element of P X T) Ep[y(gamma Lambda tau 0)], in which y(*) is the first time y meets the limit. L of its approximating (xi) over bar -Snell envelopes. To overcome the technical subtleties caused by the mutual singularity of probabilities in P and the discontinuity of the payoff process y, we approximate tau(0) by an increasing sequence of Lipschitz continuous stopping times and approximate y by a sequence of uniformly continuous processes. (C) 2016 Elsevier B.V. All rights reserved.
We establish a new type of backward stochastic differential equations(BSDEs)connected with stochastic differential games(SDGs), namely, BSDEs strongly coupled with the lower and the upper value functions of SDGs, wher...
详细信息
We establish a new type of backward stochastic differential equations(BSDEs)connected with stochastic differential games(SDGs), namely, BSDEs strongly coupled with the lower and the upper value functions of SDGs, where the lower and the upper value functions are defined through this BSDE. The existence and the uniqueness theorem and comparison theorem are proved for such equations with the help of an iteration method. We also show that the lower and the upper value functions satisfy the dynamic programming principle. Moreover, we study the associated Hamilton-Jacobi-Bellman-Isaacs(HJB-Isaacs)equations, which are nonlocal, and strongly coupled with the lower and the upper value functions. Using a new method, we characterize the pair(W, U) consisting of the lower and the upper value functions as the unique viscosity solution of our nonlocal HJB-Isaacs equation. Furthermore, the game has a value under the Isaacs’ condition.
Antagonistic dynamic games including games represented in normal form are considered. The asymptotic behaviour of value in these games is investigated as the game horizon tends to infinity (Cesaro mean) and as the dis...
详细信息
Antagonistic dynamic games including games represented in normal form are considered. The asymptotic behaviour of value in these games is investigated as the game horizon tends to infinity (Cesaro mean) and as the discounting parameter tends to zero (Abel mean). The corresponding Abelian-Tauberian theorem is established: it is demonstrated that in both families the game value uniformly converges to the same limit, provided that at least one of the limits exists. Analogues of one-sided Tauberian theorems are obtained. An example shows that the requirements are essential even for control problems.
In this paper, we aim to develop the stochastic control theory of branching diffusion processes where both the movement and the reproduction of the particles depend on the control. More precisely, we study the problem...
详细信息
In this paper, we aim to develop the stochastic control theory of branching diffusion processes where both the movement and the reproduction of the particles depend on the control. More precisely, we study the problem of minimizing the expected value of the product of individual costs penalizing the final position of each particle. In this setting, we show that the value function is the unique viscosity solution of a nonlinear parabolic PDE, that is, the Hamilton-Jacobi-Bellman equation corresponding to the problem. To this end, we extend the dynamicprogramming approach initiated by Nisio [J. Math. Kyoto Univ. 25 (1985) 549-575] to deal with the lack of independence between the particles as well as between the reproduction and the movement of each particle. In particular, we exploit the particular form of the optimization criterion to derive a weak form of the branching property. In addition, we provide a precise formulation and a detailed justification of the adequate dynamic programming principle.
This paper proposes a new sampling–based nonlinear model predictive control (MPC) algorithm, with a bound on complexity quadratic in the prediction horizon N and linear in the number of samples. The idea of the propo...
详细信息
We consider linear-quadratic optimal sampled-data control problems, where the state evolves continuously in time according to a linear control system and the control is sampled, i.e., is piecewise constant over a subd...
详细信息
We consider linear-quadratic optimal sampled-data control problems, where the state evolves continuously in time according to a linear control system and the control is sampled, i.e., is piecewise constant over a subdivision of the time interval, and the cost is quadratic. As a first result, we prove that, as the sampling periods tend to zero, the optimal sampled-data controls converge pointwise to the optimal permanent control. Then, we extend the classical Riccati theory to the sampled-data control framework, by developing two different approaches: the first one uses a recently established version of the Pontryagin maximum principle for optimal sampled-data control problems, and the second one uses an adequate version of the dynamic programming principle. In turn, we obtain a closed-loop expression for optimal sampled-data controls of linear-quadratic problems. (C) 2017 Elsevier Ltd. All rights reserved.
This paper studies the optimal consumption-investment strategy with multiple risky assets and stochastic interest rates, in which interest rate is supposed to be driven by the Vasicek model. The objective of the indiv...
详细信息
This paper studies the optimal consumption-investment strategy with multiple risky assets and stochastic interest rates, in which interest rate is supposed to be driven by the Vasicek model. The objective of the individuals is to seek an optimal consumption-investment strategy to maximize the expected discount utility of intermediate consumption and terminal wealth in the finite horizon. In the utility theory, Hyperbolic Absolute Risk Aversion (HARA) utility consists of CRRA utility, CARA utility and Logarithmic utility as special cases. In addition, HARA utility is seldom studied in continuous-time portfolio selection theory due to its sophisticated expression. In this paper, we choose HARA utility as the risky preference of the individuals. Due to the complexity of the structure of the solution to the original Hamilton-Jacobi-Bellman (HJB) equation, we use Legendre transform to change the original non-linear HJB equation into its linear dual one, whose solution is easy to conjecture in the case of HARA utility. By calculations and deductions, we obtain the closed-form solution to the optimal consumption-investment strategy in a complete market. Moreover, some special cases are also discussed in detail. Finally, a numerical example is given to illustrate our results. (C) 2016 Elsevier B.V. All rights reserved.
In this work we propose a stochastic model for a sequencing-batch reactor (SBR) and for a chemostat. Both models are described by systems of Stochastic Differential Equations (SDEs), which are obtained as limits of su...
详细信息
We prove existence and uniqueness of viscosity solutions for the problem max {-Delta(p1)u(x), -Delta(p2)u(x)} = f(x) in a bounded smooth domain Omega subset of R-N with u = g on partial derivative Omega. Here -Delta(p...
详细信息
We prove existence and uniqueness of viscosity solutions for the problem max {-Delta(p1)u(x), -Delta(p2)u(x)} = f(x) in a bounded smooth domain Omega subset of R-N with u = g on partial derivative Omega. Here -Delta(p)u = (N + p)(-1) vertical bar Du vertical bar(2-p) div (vertical bar Du vertical bar(p-2)Du) is the 1-homogeneous p-Laplacian and we assume that 2 <= p(1), p(2) <= infinity. This equation appears naturally when one considers a tug-of-war game in which one of the players (the one who seeks to maximize the payoff) can choose at every step which are the parameters of the game that regulate the probability of playing a usual tug-of-war game (without noise) or playing at random. Moreover, the operator max {-Delta(p1)u(x), -Delta(p2)u(x)} provides a natural analogue with respect to p-Laplacians to the Pucci maximal operator for uniformly elliptic operators. We provide two different proofs of existence and uniqueness for this problem. The first one is based in pure PDE methods (in the framework of viscosity solutions) while the second one is more connected to probability and uses game theory.
暂无评论