On Deep Recurrent Reinforcement Learning for Active Visual Tracking of Space Noncooperative Objects

作     者：Zhou, Dong Sun, Guanghui Zhang, Zhao Wu, Ligang 

作者机构：The Department of Control Science and Engineering Harbin Institute of Technology Harbin150001 China 

出 版 物：《arXiv》 (arXiv)

年 卷 期：2022年

核心收录：

主　　题：Markov processes 

摘      要：Active tracking of space noncooperative object that merely relies on vision camera is greatly significant for autonomous rendezvous and debris removal. Considering its Partial Observable Markov Decision Process (POMDP) property, this paper proposes a novel tracker based on deep recurrent reinforcement learning, named as RAMAVT which drives the chasing spacecraft to follow arbitrary space noncooperative object with high-frequency and near-optimal velocity control commands. To further improve the active tracking performance, we introduce Multi-Head Attention (MHA) module and Squeeze-and-Excitation (SE) layer into RAMAVT, which remarkably improve the representative ability of neural network with almost no extra computational cost. Extensive experiments and ablation study implemented on SNCOAT benchmark show the effectiveness and robustness of our method compared with other state-of-the-art algorithm. The source codes are available on https://***/Dongzhou-1996/RAMAVT. © 2022, CC BY-NC-SA.