In embedded control systems, the control input is computed based on sensing data of a plant in a processor and there is a delay, called the computationtimedelay, due to the computation and the data transmission. Whe...
详细信息
ISBN:
(纸本)9781479945528
In embedded control systems, the control input is computed based on sensing data of a plant in a processor and there is a delay, called the computationtimedelay, due to the computation and the data transmission. When we design an optimal controller, we need to take the delay into account to achieve its optimality. Moreover, in the case where it is difficult to identify a mathematical model of the plant, a model free approach is useful. Especially, the reinforcement learning-based approach has been much attention to in the design of an adaptive optimal controller. In this paper, we assume that the plant is a linear system but the parameters of the plant are unknown. Then, we apply the reinforcement learning to the design of an adaptive optimal digital controller with taking the computationtimedelay into consideration. First, we consider the case where all states of the plant are observed, and it takes ltimes to update the control input. An optimal feedback gain is learned from sequences of a pair of the state and the control input. Next, we consider the case where the control input is determined from outputs of the plant. We cannot use an observer to estimate the state of the plant since the parameters of the plant are unknown. So, we use a data-based control approach for the estimation. Finally, we apply the proposed adaptive optimal controller to attitude control of a quadrotor at the hovering state and show its efficiency by simulation.
暂无评论