In this paper, a stochastic optimal control problem is investigated in which the system is governed by a stochastic functional differential equation. In the framework of functional Ito calculus, we build the dynamic p...
详细信息
In this paper, a stochastic optimal control problem is investigated in which the system is governed by a stochastic functional differential equation. In the framework of functional Ito calculus, we build the dynamic programming principle and the related path-dependent Hamilton-Jacobi-Bellman equation. We prove that the value function is the viscosity solution of the path-dependent Hamilton-Jacobi-Bellman equation. Copyright (c) 2013 John Wiley & Sons, Ltd.
The semi-arialytical solution of transient responses and the bounded control strategy to minimize the transient responses for seismic-excited hysteretic structures are investigated in this manuscript, the hysteretic b...
详细信息
The semi-arialytical solution of transient responses and the bounded control strategy to minimize the transient responses for seismic-excited hysteretic structures are investigated in this manuscript, the hysteretic behavior is described by Duhem model while the seismic excitations by random processes with Kanai-Tajimi spectrum. The averaged Fokker-Planck-Kolmogorov equation with respect to the probability density of amplitude response is firstly derived by utilizing the stochastic averaging technique based on the generalized harmonic functions. The probability density is approximately expressed as a series expansion in terms of a set of specified basis functions with time-dependent coefficients which are determined through the Galerkin procedure. The quasi-optimal bounded control strategy to minimize the transient response is proposed based on the averaged system with respect to amplitude response and an appropriate performance index. The quasi-optimal control is derived from the minimum condition in the dynamicprogramming equation. The application and effectiveness of the proposed analytical procedure and control strategy are illustrated through one representative example. (C) 2015 Elsevier Ltd. All rights reserved.
This paper analyzes zero sum game involving hybrid controls using viscosity solution theory where both players use discrete as well as continuous controls. We study two problems, one in finite horizon and other in inf...
详细信息
This paper analyzes zero sum game involving hybrid controls using viscosity solution theory where both players use discrete as well as continuous controls. We study two problems, one in finite horizon and other in infinite horizon. In both cases, we allow the cost functionals to be unbounded with certain growth, hence the corresponding lower and upper value functions defined in Elliot-Kalton sense can be unbounded. We characterize the value functions as the unique viscosity solution of the associated lower and upper quasi variational inequalities in a suitable function class. Further we find a condition under which the game has a value for both games. The major difficulties arise due to unboundedness of value function. In infinite horizon case we prove uniqueness of viscosity solution by converting the unbounded value function into bounded ones by suitable transformation. In finite horizon case an argument is based on comparison with a supersolution.
We study the dividend optimization problem for a company where surplus in the absence of dividend payments follows a Cramer-Lundberg process compounded by constant force of interest. The company controls the times and...
详细信息
We study the dividend optimization problem for a company where surplus in the absence of dividend payments follows a Cramer-Lundberg process compounded by constant force of interest. The company controls the times and amounts of dividend payments subject to reserve constraints that dividends are not payable if the surplus is below b(0) and that a dividend payment, if any, cannot reduce the surplus to a level below b(0), and its objective is to maximize the expected total discounted dividends. We show how the optimality can be achieved under the constraints and construct an optimal strategy of a band type. (c) 2014 Elsevier B.V. All rights reserved.
This paper proposes a methodology to estimate the maximum revenue that can be generated by a company that operates a high-capacity storage device to buy or sell electricity on the day-ahead electricity market. The met...
详细信息
ISBN:
(纸本)9781479945528
This paper proposes a methodology to estimate the maximum revenue that can be generated by a company that operates a high-capacity storage device to buy or sell electricity on the day-ahead electricity market. The methodology exploits the dynamicprogramming (DP) principle and is specified for hydrogen-based storage devices that use electrolysis to produce hydrogen and fuel cells to generate electricity from hydrogen. Experimental results are generated using historical data of energy prices on the Belgian market. They show how the storage capacity and other parameters of the storage device influence the optimal revenue. The main conclusion drawn from the experiments is that it may be advisable to invest in large storage tanks to exploit the inter-seasonal price fluctuations of electricity.
This paper aims at studying a class of discontinuous deterministic control problems under state constraints using a linear programming approach. As for classical control problems (Gaitsgory and Quincampoix (2009) [16]...
详细信息
This paper aims at studying a class of discontinuous deterministic control problems under state constraints using a linear programming approach. As for classical control problems (Gaitsgory and Quincampoix (2009) [16], Goreac and Serea (2011) [19]), the primal linear problem is stated on some appropriate space of probability measures. Naturally, the support of these measures is contained in the set of constraints. This linearized value function and its dual can, alternatively, be seen as the limit of standard penalized problems. Second, we provide a semigroup property for this set of probability measures leading to dynamic programming principles for control problems under state constraints. An abstract principle is provided for general bounded cost. Linearized versions are obtained under further (semi)continuity assumptions. (c) 2012 Elsevier Inc. All rights reserved.
We propose a linearized formulation for min-max control problems with separated dynamics. First, we investigate the existence of the value function and saddle points for semicontinuous costs. Second, we obtain dual fo...
详细信息
We propose a linearized formulation for min-max control problems with separated dynamics. First, we investigate the existence of the value function and saddle points for semicontinuous costs. Second, we obtain dual formulations and dynamic programming principles. Copyright (c) 2013 John Wiley & Sons, Ltd.
In this paper we study stochastic optimal control problems of fully coupled forward-backward stochastic differential equations (FBSDEs). The recursive cost functionals are defined by controlled fully coupled FBSDEs. W...
详细信息
In this paper we study stochastic optimal control problems of fully coupled forward-backward stochastic differential equations (FBSDEs). The recursive cost functionals are defined by controlled fully coupled FBSDEs. We use a new method to prove that the value functions are deterministic, satisfy the dynamic programming principle, and are viscosity solutions to the associated generalized Hamilton-Jacobi-Bellman (HJB) equations. For this we generalize the notion of stochastic backward semigroup introduced by Peng Topics on Stochastic Analysis, Science Press, Beijing, 1997, pp. 85-138. We emphasize that when sigma depends on the second component of the solution (Y, Z) of the BSDE it makes the stochastic control much more complicated and has as a consequence that the associated HJB equation is combined with an algebraic equation. We prove that the algebraic equation has a unique solution, and moreover, we also give the representation for this solution. On the other hand, we prove a new local existence and uniqueness result for fully coupled FBSDEs when the Lipschitz constant of sigma with respect to z is sufficiently small. We also establish a generalized comparison theorem for such fully coupled FBSDEs.
This paper is concerned with the Sobolev weak solutions of the Hamilton-Jacobi-Bellman (HJB) equations. These equations are derived from the dynamic programming principle in the study of stochastic optimal control pro...
详细信息
This paper is concerned with the Sobolev weak solutions of the Hamilton-Jacobi-Bellman (HJB) equations. These equations are derived from the dynamic programming principle in the study of stochastic optimal control problems. Adopting the Doob-Meyer decomposition theorem as one of the main tools, we prove that the optimal value function is the unique Sobolev weak solution of the corresponding HJB equation. In the recursive optimal control problem, the cost function is described by the solution of a backward stochastic differential equation (BSDE). This problem has a practical background in economics and finance. We prove that the value function is the unique Sobolev weak solution of the related HJB equation by virtue of the nonlinear Doob-Meyer decomposition theorem introduced in the study of BSDEs.
In this paper, we study a stochastic recursive optimal control problem in which the objective functional is described by the solution of a backward stochastic differential equation driven by -Brownian motion. Under st...
详细信息
In this paper, we study a stochastic recursive optimal control problem in which the objective functional is described by the solution of a backward stochastic differential equation driven by -Brownian motion. Under standard assumptions, we establish the dynamic programming principle and the related Hamilton-Jacobi-Bellman (HJB) equation in the framework of -expectation. Finally, we show that the value function is the viscosity solution of the obtained HJB equation.
暂无评论