检索结果-内蒙古大学图书馆

Offline-Online Actor-Critic

学校读者我要写书评

暂无评论

IEEE Transactions on Artificial Intelligence 2024年第1期5卷 61-69页

作者： Wang, Xuesong Hou, Diyuan Huang, Longyang Cheng, Yuhu China University of Mining and Technology Engineering Research Center of Intelligent Control for Underground Space Ministry of Education and School of Information and Control Engineering Xuzhou221116 China

Offline-online reinforcement learning (RL) can effectively address the problem of missing data (commonly known as transition) in offline RL. However, due to the effect of distribution shift, the performance of policy may degrade when an agent moves from offline to online training phases. In this article, we first analyze the problems of distribution shift and policy performance degradation in offline-online RL. Then, in order to alleviate these problems, we propose a novel RL algorithm offline-online actor-critic (O2AC) algorithm. In O2AC, a behavior clone constraint term is introduced into the policy objective function to address the distribution shift in offline training phase. In addition, in online training phase, the influence of the behavior clone constraint term is gradually reduced, which alleviates the policy performance degradation. Experiments show that O2AC outperforms existing offline-online RL algorithms. © 2020 IEEE.

关键词： Reinforcement learning

Anti-Interference High-Speed Modulation Decoder for Quantum Key Distribution

学校读者我要写书评

暂无评论

Chinese Physics Letters 2025年第1期42卷 34-39页

作者： Hua-Xing Xu Shao-Hua Wang Chang-Lei Wang Ping Zhang National Engineering Research Center for Public Safety Risk Perception and Control by Big Data China Academic of Electronics and Information TechnologyBeijing 100041China CETC Academy of Electronics and Information Technology Group Co. Ltd.Beijing 100041China

Quantum key distribution is increasingly transitioning toward network applications,necessitating advancements in system performance,including photonic integration for compact designs,enhanced stability against environmental disturbances,higher key rates,and improved *** this letter,we propose an orthogonal polarization exchange reflector Michelson interferometer model to address quantum channel disturbances caused by environmental *** on this model,we designed a Sagnac reflector-Michelson interferometer decoder and verified its performance through an interference *** interference fringe visibility exceeded 98%across all four coding phases at 625 *** results indicate that the decoder effectively mitigates environmental interference while supporting high-speed modulation *** addition,the proposed anti-interference decoder,which does not rely on magneto-optical devices,is well-suited for photonic integration,aligning with the development trajectory for next-generation quantum communication devices.

关键词： decoder interferometer polarization

Proximal Policy Optimization With Advantage Reuse Competition

学校读者我要写书评

暂无评论

IEEE Transactions on Artificial Intelligence 2024年第8期5卷 3915-3925页

作者： Cheng, Yuhu Guo, Qingbang Wang, Xuesong Engineering Research Center of Intelligent Control for Underground Space Ministry of Education Xuzhou221116 China China University of Mining and Technology School of Information and Control Engineering Xuzhou221116 China

In recent years, reinforcement learning (RL) has made great achievements in artificial intelligence. Proximal policy optimization (PPO) is a representative RL algorithm, which limits the magnitude of each policy update to achieve monotonic policy improvement. However, as an on-policy algorithm, PPO suffers from sample inefficiency and poor policy exploratory. To solve above problems, the off-policy advantage is proposed, which calculates the advantage function through the reuse of previous policy, and the proximal policy optimization with advantage reuse (PPO-AR) is proposed. Furthermore, to improve the sampling efficiency of policy update, the proximal policy optimization with advantage reuse competition (PPO-ARC) is proposed, which introduces PPO-AR into the policy calculation and uses the parallel competitive optimization, and it is shown to improve the performance of policy. Moreover, to improve the exploratory of policy update, the proximal policy optimization with generalized clipping (PPO-GC) is proposed, which relaxes the limits of policy update by changing the policy flat clipping boundary. Experimental results on OpenAI Gym demonstrate the effectiveness of our proposed PPO-ARC and PPO-GC. © 2020 IEEE.

关键词： Reinforcement learning

Key Technologies for Machine Vision for Picking Robots:Review and Benchmarking

学校读者我要写书评

暂无评论

Machine Intelligence Research 2025年第1期22卷 2-16页

作者： Xu Xiao Yiming Jiang Yaonan Wang College of Electrical and Information Engineering Hunan UniversityChangsha 410082China National Engineering Research Center for Robot Vision Perception and Control Technology Hunan UniversityChangsha 410082China

The increase in precision agriculture has promoted the development of picking robot technology,and the visual recognition system at its core is crucial for improving the level of agricultural *** paper reviews the progress of visual recognition tech-nology for picking robots,including image capture technology,target detection algorithms,spatial positioning strategies and scene *** article begins with a description of the basic structure and function of the vision system of the picking robot and em-phasizes the importance of achieving high-efficiency and high-accuracy recognition in the natural agricultural ***-sequently,various image processing techniques and vision algorithms,including color image analysis,three-dimensional depth percep-tion,and automatic object recognition technology that integrates machine learning and deep learning algorithms,were *** the same time,the paper also highlights the challenges of existing technologies in dynamic lighting,occlusion problems,fruit maturity di-versity,and real-time processing *** paper further discusses multisensor information fusion technology and discusses methods for combining visual recognition with a robot control system to improve the accuracy and working rate of *** the same time,this paper also introduces innovative research,such as the application of convolutional neural networks(CNNs)for accurate fruit detection and the development of event-based vision systems to improve the response speed of the *** the end of this paper,the future development of visual recognition technology for picking robots is predicted,and new research trends are proposed,including the refinement of algorithms,hardware innovation,and the adaptability of technology to different agricultural *** purpose of this paper is to provide a comprehensive analysis of visual recognition technology for researchers and practitioners in the field of agricul-tural rob

关键词： Picking robot visual system perception technology image processing machine learning deep learning.

Adaptive control of a Flexible Manipulator With Unknown Hysteresis and Intermittent Actuator Faults

学校读者我要写书评

暂无评论

IEEE/CAA Journal of Automatica Sinica 2025年第1期12卷 148-158页

作者： Shouyan Chen Weitian He Zhijia Zhao Yun Feng Zhijie Liu Keum-Shik Hong School of Mechanical and Electrical Engineering Guangzhou University the School of Control Science and Engineering Shandong University IEEE the College of Electrical and Information Engineering Hunan University the National Engineering Research Center for Robot Visual Perception and Control Technology Hunan University the School of Intelligence Science and Technology University of Science and Technology Beijing (USTB) the Institute for Future the School of AutomationQingdao University the School of Mechanical Engineering Pusan National University

In this study, we consider a single-link flexible manipulator in the presence of an unknown Bouc-Wen type of hysteresis and intermittent actuator faults. First, an inverse hysteresis dynamics model is introduced, and then the control input is divided into an expected input and an error compensator. Second,a novel adaptive neural network-based control scheme is proposed to cancel the unknown input hysteresis. Subsequently,by modifying the adaptive laws and local control laws, a fault-tolerant control strategy is applied to address uncertain intermittent actuator faults in a flexible manipulator system. Through the direct Lyapunov theory, the proposed scheme allows the state errors to asymptotically converge to a specified interval. Finally,the effectiveness of the proposed scheme is verified through numerical simulations and experiments.

关键词： Adaptive control flexible manipulator intermittent actuator faults inverse hysteresis dynamics vibration control

Deep-Learning-Based Uncertainty-Estimation Approach for Unknown Traffic Identification

学校读者我要写书评

暂无评论

IEEE Transactions on Artificial Intelligence 2025年第3期6卷 533-548页

作者： Le, Siqi Lai, Yingxu Wang, Yipeng He, Huijie Beijing University of Technology Faculty of Information Technology Beijing100124 China Ministry of Education Engineering Research Center of Intelligent Perception and Autonomous Control Beijing100124 China

Real open network environments include the traffic generated by known applications or protocols, which have been previously identified and labeled, and unknown network traffic that cannot be identified based on existing knowledge. Accurately identifying unknown traffic is critical to network management and security, not only to help managers allocate bandwidth appropriately for all types of applications and ensure quality of service but also to prevent security breaches that may result from unknown applications or protocols. Notably, the unknown network traffic has been increasing with the emergence of new applications or protocols, which further increases the difficulty in identifying them. Existing unknown traffic classification methods based on Softmax output confidence values cause bias in the prediction probability due to overconfidence of the model during the training process, thus decreasing the identification accuracy. Thus, for unknown traffic identification, this study proposes a deep-learning-based uncertainty-estimation (EUE) approach. EUE introduces the theory of evidence to the task of identifying unknown traffic by inferring traffic uncertainty directly from traffic evidence without the need for a Softmax layer, thus avoiding overconfidence in the model. Thus, the EUE can accurately identify unknown traffic while classifying known traffic at the application level. We construct two experimental scenarios simulating the real network environments with different proportions of unknown traffic to evaluate EUE. The experimental results show that the proposed approach EUE exhibits excellent classification accuracy. © 2024 IEEE. All rights reserved.

关键词： Internet protocols

Multiobjective Differential Evolution for Higher-Dimensional Multimodal Multiobjective Optimization

学校读者我要写书评

暂无评论

IEEE/CAA Journal of Automatica Sinica 2024年第6期11卷 1458-1475页

作者： Jing Liang Hongyu Lin Caitong Yue Ponnuthurai Nagaratnam Suganthan Yaonan Wang School of Electrical and Information Engineering Zhengzhou UniversityZhengzhou 450001 School of Electrical Engineering and Automation Henan Institute of TechnologyXinxiang 453003China School of Electrical and Information Engineering Zhengzhou UniversityZhengzhou 450001China KINDI Center for Computing Research Qatar UniversityDohaQatarand also with the Nanyang Technology UniversitySingapore College of Electrical and Information Engineering and also with the National Engineering Research Center for Robot Visual Perception and Control TechnologyHunan UniversityChangsha 410082China IEEE

In multimodal multiobjective optimization problems(MMOPs),there are several Pareto optimal solutions corre-sponding to the identical objective *** paper proposes a new differential evolution algorithm to solve MMOPs with higher-dimensional decision *** to the increase in the dimensions of decision variables in real-world MMOPs,it is diffi-cult for current multimodal multiobjective optimization evolu-tionary algorithms(MMOEAs)to find multiple Pareto optimal *** proposed algorithm adopts a dual-population framework and an improved environmental selection *** utilizes a convergence archive to help the first population improve the quality of *** improved environmental selection method enables the other population to search the remaining decision space and reserve more Pareto optimal solutions through the information of the first *** combination of these two strategies helps to effectively balance and enhance conver-gence and diversity *** addition,to study the per-formance of the proposed algorithm,a novel set of multimodal multiobjective optimization test functions with extensible decision variables is *** proposed MMOEA is certified to be effective through comparison with six state-of-the-art MMOEAs on the test functions.

关键词： Benchmark functions diversity measure evolution-ary algorithms multimodal multiobjective optimization.

Focal Transfer Graph Network and Its Application in Cross-Scene Hyperspectral Image Classification

学校读者我要写书评

暂无评论

IEEE Transactions on Artificial Intelligence 2024年第8期5卷 4013-4025页

作者： Wang, Haoyu Liu, Xiaomin the Engineering Research Center of Intelligent Control for Underground Space Ministry of Education China University of Mining and Technology Xuzhou 221116 China and also with the School of Information and Control Engineering China University of Mining and Technology Xuzhou 221116 China

Affected by the sensor, shooting environment, and other aspects, hyperspectral images (HSIs) in the source and target domains exhibit phenomenon of difficult feature extraction and domain shift. The above phenomena pose challenges to the cross-scene HSI classification task. Therefore, a focal transfer graph network (FTGN) for cross-scene HSI classification is proposed. First, FTGN leverages graph sample and aggregate (GraphSAGE) to capture spatial-spectral features by aggregating partial adjacency nodes, ensuring the acquisition of contextual information. The neighbor weighting strategy based on spatial-spectral information is proposed to solve the information interference caused by excessive node aggregation. Second, a pseudolabel trimming strategy based on class metrics is proposed to reduce the adverse effects of pseudolabel noise in the transfer process. Then, a specification subdomain adaptation (SSA) module is proposed, which helps to achieve effective distribution alignment by reducing the feature distance of intraclass samples and widening the feature distance of interclass samples during the subdomain adaptation process. Finally, the focal loss is utilized to help FTGN focus on hard-to-classify samples. The experimental results on eight data pairs show that the proposed method outperforms several state-of-the-art methods. © 2020 IEEE.

关键词： Data mining

Intelligent proportioning model of converter scrap based on optimization algorithm

学校读者我要写书评

暂无评论

Progress in Natural Science:Materials International 2024年第1期34卷 37-44页

作者： Chaojie Zhang Jinjun Cheng Liqiang Zhang Yingxue Wang Wei Zhang Jianwei Yuan Haichuan Wang School of Metallurgical Engineering Anhui University of Technology National Engineering Research Center for Public Safety Risk Perception and Control by Big Data(RPP) China Academic of Electronics and Information Technology Wuhu Xinxing Pipes Co. Ltd.

Scrap is one of the main raw materials in converter steelmaking. Due to the wide variety of scrap and the significant differences in its prices, the proportioning of scrap presents a challenge in converter steelmaking. This paper explores the optimal proportioning method of scrap for converters using an optimization mathematical model. Initially, the melting characteristics of scrap after being added to the converter's molten iron were investigated using finite element numerical simulations. The study found that when the weight of the scrap is fixed, both the shape and type of the scrap significantly influence the melting time. Subsequently, employing mathematical optimization methods and considering comprehensive process parameters of the 210t converter smelting, including the composition and unit price of the scrap, as well as the requirements of the converter steelmaking process for scrap, an optimization model for the proportioning of scrap in converters was *** model was solved using computer programming languages. Through this optimization model, it is possible to obtain the lowest cost per ton of molten steel in the converter smelting process by determining the optimal proportions of various types of scrap.

关键词： scrap proportioning Optimization model Converter steelmaking mathematical model numerical simulation