检索结果-内蒙古大学图书馆

DouZero+: Improving DouDizhu AI by Opponent Modeling and Coach-guided Learning

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zhao, Youpeng Zhao, Jian Hu, Xunhan Zhou, Wengang Li, Houqiang CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System Department of Electronic Engineering and Information Science University of Science and Technology of China Hefei230027 China Institute of Artificial Intelligence Hefei Comprehensive National Science Center Hefei China

Recent years have witnessed the great breakthrough of deep reinforcement learning (DRL) in various perfect and imperfect information games. Among these games, DouDizhu, a popular card game in China, is very challenging due to the imperfect information, large state space, elements of collaboration and a massive number of possible moves from turn to turn. Recently, a DouDizhu AI system called DouZero has been proposed. Trained using traditional Monte Carlo method with deep neural networks and self-play procedure without the abstraction of human prior knowledge, DouZero has outperformed all the existing DouDizhu AI programs. In this work, we propose to enhance DouZero by introducing opponent modeling into DouZero. Besides, we propose a novel coach network to further boost the performance of DouZero and accelerate its training process. With the integration of the above two techniques into DouZero, our DouDizhu AI system achieves better performance and ranks top in the Botzone leaderboard among more than 400 AI agents, including DouZero. Copyright © 2022, The Authors. All rights reserved.

关键词： Reinforcement learning

Performance Analysis of NOMA-Based Cooperative Networks with Relay Selection

学校读者我要写书评

暂无评论

China Communications 2020年第11期17卷 111-119页

作者： Ronglan Huang Dehuan Wan Fei Ji Hua Qing Jie Li Hua Yu Fangjiong Chen Guangxi Colleges and Universities Key Laboratory of Image Processing and Intelligent Information System Wuzhou UniversityWuzhou 543002China Guangdong University of Finance Guangzhou 510521China School of Electronic and Information Engineering South China University of TechnologyGuangzhou 510641China Key Laboratory of Marine Environmental Survey Technology and Application Ministry of Natural ResourcesGuangzhou510300China

Non-orthogonal multiple access(NOMA)technique is an expert on channel differences *** this paper,a dual-hop NOMA-based cooperative relaying network where a best relay is selected as an active node to accomplish the communication between a source and a destination is *** assume that both decode-and-forward(DF)and amplify-and-forward(AF)protocols are applied to the selected *** metrics that ergodic sum-rate and outage probability are investigated,and the closed-form expressions of the latter for DF and AF protocols are *** and simulation results are conducted to verify the validity of the theoretical analysis,in which we can see that the NOMA based DF relaying is better than the NOMA based AF relaying and other existing NOMA-based cooperative communication schemes.

关键词： non-orthogonal multiple access(NOMA) decode-and-forward(DF) amplify-and-forward(AF) relay selection ergodic sum-rate outage probability

Robust Eigenvectors of Regular Simplex Tensors: Conjecture Proof

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Wang, Lei Geng, Xiurui Zhang, Lei The School of Microelectronics and Communication Engineering Chongqing University Chongqing400044 China Aerospace Information Research Institute Chinese Academy of Sciences Beijing100094 China University of the Chinese Academy of Sciences Beijing100049 China Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Chinese Academy of Science Beijing100190 China

The concept of tensor eigenpairs has received more researches in past decades. Recent works have paid attentions to a special class of symmetric tensors termed regular simplex tensors, which is constructed by equiangular tight frame of n + 1 vectors in n-dimensional space, and the robustness of eigenpairs was investigated. In the end of the literature, a conjecture was claimed that the robust eigenvectors of a regular simplex tensor are precisely the vectors in the frame. One later work theoretically proved that the case of n = 2 was true. In this paper, we proceed further and complete the proof for the above conjecture. Some promising directions are discussed in the end for future *** Codes 15A69, 90C26 © 2023, CC BY.

关键词： Tensors

Vision-Language Consistency Guided Multi-modal Prompt Learning for Blind AI Generated Image Quality Assessment

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Fu, Jun Zhou, Wei Jiang, Qiuping Liu, Hantao Zhai, Guangtao The CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei230027 China The School of Computer Science and Informatics Cardiff University CardiffCF24 4AG United Kingdom The School of Information Science and Engineering Ningbo University Ningbo315211 China The Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai200240 China

Recently, textual prompt tuning has shown inspirational performance in adapting Contrastive Language-Image Pre-training (CLIP) models to natural image quality assessment. However, such uni-modal prompt learning method only tunes the language branch of CLIP models. This is not enough for adapting CLIP models to AI generated image quality assessment (AGIQA) since AGIs visually differ from natural images. In addition, the consistency between AGIs and user input text prompts, which correlates with the perceptual quality of AGIs, is not investigated to guide AGIQA. In this letter, we propose vision-language consistency guided multi-modal prompt learning for blind AGIQA, dubbed CLIP-AGIQA. Specifically, we introduce learnable textual and visual prompts in language and vision branches of CLIP models, respectively. Moreover, we design a text-to-image alignment quality prediction task, whose learned vision-language consistency knowledge is used to guide the optimization of the above multi-modal prompts. Experimental results on two public AGIQA datasets demonstrate that the proposed method outperforms state-of-the-art quality assessment models. The source code is available at https://***/JunFu1995/CLIP-AGIQA. © 2024, CC BY-NC-ND.

关键词： Learning systems

Simultaneous Double Q-learning with Conservative Advantage Learning for Actor-Critic Methods

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Li, Qing Zhou, Wengang Lu, Zhenbo Li, Houqiang The CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System Department of Electronic Engineering and Information Science University of Science and Technology of China Hefei230027 China The Institute of Artificial Intelligence Hefei Comprehensive National Science Center Hefei230000 China

Actor-critic Reinforcement Learning (RL) algorithms have achieved impressive performance in continuous control tasks. However, they still suffer two nontrivial obstacles, i.e., low sample efficiency and overestimation bias. To this end, we propose Simultaneous Double Q-learning with Conservative Advantage Learning (SDQ-CAL). Our SDQ-CAL boosts the Double Q-learning for off-policy actor-critic RL based on a modification of the Bellman optimality operator with Advantage Learning. Specifically, SDQ-CAL improves sample efficiency by modifying the reward to facilitate the distinction from experience between the optimal actions and the others. Besides, it mitigates the overestimation issue by updating a pair of critics simultaneously upon double estimators. Extensive experiments reveal that our algorithm realizes less biased value estimation and achieves state-of-the-art performance in a range of continuous control benchmark tasks. We release the source code of our method at: https://***/LQNew/SDQ-CAL. Copyright © 2022, The Authors. All rights reserved.

关键词： Reinforcement learning

TomoSAR-ALISTA: Efficient TomoSAR imaging via deep unfolded network

学校读者我要写书评

暂无评论

TomoSAR-ALISTA: Efficient TomoSAR imaging via deep unfolded ...

International Conference on Radar systems (RADAR 2022)

作者： M. Wang Z. Zhang Y. Wang S. Gao X. Qiu Key Laboratory of Technology in Geo-spatial Information Processing and Application System Chinese Academy of Sciences Beijing 100190 People's Republic of China Key Laboratory of Intelligent Aerospace Big Data Application Technology Suzhou 215123 People's Republic of China Electrical and Computer Engineering Department George Mason University Fairfax VA 22030 USA

ISBN: (数字)9781839537776

Synthetic aperture radar (SAR) tomography (TomoSAR) has attracted remarkable interest for its ability in achieving threedimensional reconstruction along the elevation direction from multiple observations. In recent years, compressed sensing (CS) technique has been introduced into TomoSAR considering for its super-resolution ability with limited samples. Whereas, the CS-based methods suffer from several drawbacks, including weak noise resistance, high computational complexity and complex parameter fine-tuning. Among the different CS algorithms, iterative soft-thresholding algorithm (ISTA) is widely used as a robust reconstruction approach, however, the parameters in the ISTA are manually chosen, which usually requires a time-consuming fine-tuning process to achieve the best performance. Aiming at efficient TomoSAR imaging, a novel sparse unfolding network named analytic learned ISTA (ALISTA) is proposed towards the TomoSAR imaging problem in this paper, and the key parameters of ISTA are learned from training data via deep learning to avoid complex parameter fine-tuning and significantly relieves the training burden. In addition, experiments verify that it is feasible to use traditional CS algorithms as training labels, which provides a tangible supervised training method to achieve better 3D reconstruction performance even in the absence of labeled data in real applications.

关键词：

AF2S: An Anchor-Free Two-Stage Tracker Based on a Strong SiamFC Baseline 16th

学校读者我要写书评

暂无评论

AF2S: An Anchor-Free Two-Stage Tracker Based on a Strong Sia...

Workshops held at the 16th European Conference on Computer Vision, ECCV 2020

作者： He, Anfeng Wang, Guangting Luo, Chong Tian, Xinmei Zeng, Wenjun CAS Key Laboratory of Technology in Geo-Spatial Information Processing and Application System University of Science and Technology of China Hefei Anhui China Microsoft Research Asia Beijing China

ISBN: (纸本)9783030682378

Siamese network based trackers have become a mainstream in visual object tracking. Recently, several high-performance multi-stage trackers have been proposed and some of them adopt SiamRPN for the first-stage region proposal. We argue that an anchor-based region proposal network is not necessary for the tracking task, as a tracker has a strong prior about the location and size of the target. In this paper, we propose a two-stage visual tracker which uses SiamFC for region proposal. SiamFC defines a bounding box by its center, which is a typical anchor-free (AF) network, so we dub our tracker AF2S. As the model size of SiamFC is only about 1/10 that of SiamRPN, AF2S results in a significantly lighter model than its SiamRPN-based counterparts. In the design of AF2S, we first build a strong AlexNet-based SiamFC baseline which improves the AUC on OTB-100 from 0.582 to 0.665. Further, we propose a position-sensitive convolutional layer which can be stacked after SiamFC backbone to increase the robustness of proposals without losing localization precision. Finally, a relation network is used for box refinement. Experimental results show that AF2S achieves the best performance on OTB-100 and VOT-18 among the state-of-the-art trackers which use AlexNet as backbone. On LaSOT-test, AF2S achieves an AUC of 0.480, which is among the first-tier performance even when trackers with more powerful backbone and much larger model size are considered. © 2020, Springer Nature Switzerland AG.

关键词： Tracking (position)

Quantum-behaved PSO-based Lyapunov control of closed quantum systems

学校读者我要写书评

暂无评论

Quantum-behaved PSO-based Lyapunov control of closed quantum...

第40届中国控制会议

作者： Song Liu Sen Kuang Department of Automation University of Science and Technology of China CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System University of Science and Technology of China

A Lyapunov-based control scheme is presented to drive closed quantum systems into any target eigenstate with as high population as possible by the quantum-behaved particle swarm optimization（PSO） algorithm. Based on a Lyapunov function with a Hermitian operator to be constructed, a control law with the unknown parameters contained in the Hermitian operator is designed. To achieve high-population state transfer to the target state, we first initialize those unknown parameters by choosing a path to the target state in its energy-level connectivity graph and setting their values along the path. Then, a set of optimal parameters is found by the quantum-behaved PSO algorithm. Finally, numerical simulation experiments are performed on a five-level quantum system and a four-qubit system to demonstrate the effectiveness of the control scheme in this paper.

关键词： Quantum systems Lyapunov control quantum-behaved PSO algorithm energy-level connectivity graph high-population transfer

ATASI-Net: An Efficient Sparse Reconstruction Network for Tomographic SAR Imaging with Adaptive Threshold

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wang, Muhan Zhang, Zhe Qiu, Xiaolan Gao, Silin Wang, Yue Suzhou Key Laboratory of Microwave Imaging Processing and Application Technology China Suzhou Aerospace Information Research Institute Jiangsu Suzhou China Aerospace Information Research Institute Chinese Academy of Sciences China School of Electronic Electrical and Communication Engineering University of Chinese Academy of Sciences Beijing China The Key Laboratory of Technology in Geo-spatial Information Processing and Application System Chinese Academy of Sciences Beijing China Electrical and Computer Engineering Department George Mason University FairfaxVA United States

Tomographic SAR technique has attracted remarkable interest for its ability of three-dimensional resolving along the elevation direction via a stack of SAR images collected from different cross-track angles. The emerged compressed sensing (CS)-based algorithms have been introduced into TomoSAR considering its super-resolution ability with limited samples. However, the conventional CS-based methods suffer from several drawbacks, including weak noise resistance, high computational complexity, and complex parameter fine-tuning. Aiming at efficient TomoSAR imaging, this paper proposes a novel efficient sparse unfolding network based on the analytic learned iterative shrinkage thresholding algorithm (ALISTA) architecture with adaptive threshold, named Adaptive Threshold ALISTA-based Sparse Imaging Network (ATASI-Net). The weight matrix in each layer of ATASI-Net is pre-computed as the solution of an offline optimization problem, leaving only two scalar parameters to be learned from data, which significantly simplifies the training stage. In addition, adaptive threshold is introduced for each azimuth-range pixel, enabling the threshold shrinkage to be not only layer-varied but also element-wise. Moreover, the final learned thresholds can be visualized and combined with the SAR image semantics for mutual feedback. Finally, extensive experiments on simulated and real data are carried out to demonstrate the effectiveness and efficiency of the proposed method. Copyright © 2022, The Authors. All rights reserved.

关键词： Semantics