This paper addresses the problem of generating autonomously an optimal control action sequence for ship steering control based on Adaptive Critic Designs. The principal objective is to autonomously design an optimal c...
详细信息
This paper addresses the problem of generating autonomously an optimal control action sequence for ship steering control based on Adaptive Critic Designs. The principal objective is to autonomously design an optimal controller that steers the center of the ship through a number of gates in a particular order using a minimum amount of time. In general, the steering of mobile vehicles depend on the interactions between a vehicle and its supporting medium. Nautical ships present particularly longtime delays in response to rudder movements (control actions). Planning for the future encounters with gates should be part of the current control decision, since the ship's position and orientation as it moves through one gate greatly affect the ease of navigation through successive gates. The proposed adaptive critic design-based controller learns to guide the ship through a set of gates autonomously. The simulation results show the performance of the proposed approach.
We consider a general class of discrete-time nonlinear stochastic control problems with partial observation, for which in general only εε\varepsilon -optimal controls exist, and provide a method for explicitly compu...
详细信息
We consider a general class of discrete-time nonlinear stochastic control problems with partial observation, for which in general only ε-optimal controls exist, and provide a method for explicitly computing them. Transforming, as usual, these problems into equivalent ones with complete observation leads to various difficulties, in particular to a nonlinear filtering problem. We first define a subclass of the given problems such that the associated nonlinear filtering problem can be explicitly solved and, for each
关键词:
93E26
93E11
93E25
stochastic control
nonlinear filtering
ε-optimal controls
approximate dynamic programming
暂无评论