In this paper, we examine an exponential stability result in L2- norm of the classical solution of shallow water equations. By using Riemann analysis with sub-critical flow condition, we show that only one boundary co...
详细信息
In this paper we study mean-field type control problems with risk-sensitive performance functionals. We establish a stochastic maximum principle (SMP) for optimal control of stochastic differential equations (SDEs) of...
详细信息
Mean-field games have been studied under the assumption of very large number of players. For such large systems, the basic idea consists to approximate large games by a stylized game model with a continuum of players....
详细信息
In the standard formulation of a game, a player's payoff function depends on the states and actions of all the players. Yet, real world applications suggest to consider also a functional of the probability measure...
详细信息
In this paper we examine combined fully distributed payoff and strategy learning (CODIPAS) in a queue-aware access game over a graph. The classical strategic learning analysis relies on vanishing or small learning rat...
详细信息
In the standard formulation of a game, a player's payoff function depends on the states and actions of all the players. Yet, real world applications suggest to consider also a functional of the probability measure...
详细信息
In the standard formulation of a game, a player's payoff function depends on the states and actions of all the players. Yet, real world applications suggest to consider also a functional of the probability measure of states and actions of all the players. In this paper, we consider cooperative mean-field type games in which the state dynamics and the payoffs depend not only on the state and actions but also on their probability measure. We establish stochastic maximum principle and provide a time-dependent payoff allocation procedure for coalitions. The allocated payoff considers not only fairness property but also the cost of making the coalition. Finally, time consistency and subgame perfectness solution concept equations are established.
In this paper we examine combined fully distributed payoff and strategy learning (CODIPAS) in a queue-aware access game over a graph. The classical strategic learning analysis relies on vanishing or small learning rat...
详细信息
In this paper we examine combined fully distributed payoff and strategy learning (CODIPAS) in a queue-aware access game over a graph. The classical strategic learning analysis relies on vanishing or small learning rate and uses stochastic approximation tool to derive steady states and invariant sets of the underlying learning process. Here, the stochastic approximation framework does not apply due to non-vanishing learning rate. We propose a direct proof of convergence of the process. Interestingly, the convergence time to one of the global optima is almost surely finite and we explicitly characterize the convergence time. We show that pursuit-based CODIPAS learning is much faster than the classical learning algorithms in games. We extend the methodology to coalitional learning and proves a very fast formation of coalitions for queue-aware access games where the action space is dynamically changing depending on the location of the user over a graph.
Mean-field games have been studied under the assumption of very large number of players. For such large systems, the basic idea consists to approximate large games by a stylized game model with a continuum of players....
详细信息
Mean-field games have been studied under the assumption of very large number of players. For such large systems, the basic idea consists to approximate large games by a stylized game model with a continuum of players. The approach has been shown to be useful in some applications. However, the stylized game model with continuum of decision-makers is rarely observed in practice and the approximation proposed in the asymptotic regime is meaningless for networked systems with few entities. In this paper we propose a mean-field framework that is suitable not only for large systems but also for a small world with few number of entities. The applicability of the proposed framework is illustrated through a dynamic auction with asymmetric valuation distributions.
In this paper, we develop a novel mechanism for reducing volatility of residential demand for electricity We construct a reward-based (rebate) mechanism that provides consumers with incentives to shift their demand to...
详细信息
In this paper we study mean-field type control problems with risk-sensitive performance functionals. We establish a stochastic maximum principle for optimal control of stochastic differential equations of mean-field t...
详细信息
ISBN:
(纸本)9781467360890
In this paper we study mean-field type control problems with risk-sensitive performance functionals. We establish a stochastic maximum principle for optimal control of stochastic differential equations of mean-field type, in which the drift and the diffusion coefficients as well as the performance functional depend not only on the state and the control but also on the mean of the distribution of the state. Our result extends to optimal control problems for non-Markovian dynamics which may be time-inconsistent in the sense that the Bellman optimality principle does not hold. For a general action space a Peng's type stochastic maximum principle is derived, specifying the necessary conditions for optimality. Two examples are carried out to illustrate the proposed risk-sensitive mean-field type under linear stochastic dynamics with exponential quadratic cost function. Explicit characterizations are given for both mean-field free and mean-field risk-sensitive models.
暂无评论