检索结果-内蒙古大学图书馆

Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced control Applications

IEEE/CAA Journal of Automatica Sinica 2024年第1期11卷 18-36页

作者： Ding Wang Ning Gao Derong Liu Jinna Li Frank L.Lewis IEEE the Faculty of Information Technology Beijing Key Laboratory of Computational Intelligence and Intelligent SystemBeijing Laboratory of Smart Environmental Protectionand Beijing Institute of Artificial IntelligenceBeijing University of TechnologyBeijing 100124China the School of System Design and Intelligent Manufacturing Southern University of Science and TechnologyShenzhen 518055China the Department of Electrical and Computer Engineering University of Illinois at ChicagoChicago IL 60607 USA the School of Information and Control Engineering Liaoning Petrochemical UniversityFushun 113001China the UTA Research Institute the University of Texas at ArlingtonArlington TX 76118 USA

Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, ***, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation ***, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.

关键词： Adaptive dynamic programming(ADP) advanced control complex environment data-driven control event-triggered design intelligent control neural networks nonlinear systems optimal control reinforcement learning(RL)

来源：评论

学校读者我要写书评

暂无评论

Brain-inspired Intelligent Robotics:Theoretical Analysis and systematic Application

引用

machine intelligence Research 2023年第1期20卷 1-18页

作者： Hong Qiao Ya-Xiong Wu Shan-Lin Zhong Pei-Jie Yin Jia-Hao Chen The State Key Laboratory of Management and Control for Complex System Institute of AutomationChineseAcademyof SciencesBeijing100190China School of Artificial Intelligence University of Chinese Academy of SciencesBeijing 100049China Chinese Academy of Science Center for Excellence in Brain Science and Intelligence Technology Shanghai 200031China School of Mechanical Engineering University of Science and Technology BeijingBeijing 100083China

Traditional joint-link robots have been widely used in production lines because of their high precision for single *** the development of the manufacturing and service industries,the requirement for the comprehensive performance of robotics is *** types of bio-inspired robotics have been investigated to realize human-like motion control and manipulation.A study route from inner mechanisms to external structures is proposed to imitate humans and animals *** this idea,a brain-inspired intelligent robotic system is constructed that contains visual cognition,decision-making,motion control,and musculoskeletal *** paper reviews cutting-edge research in brain-inspired visual cognition,decision-making,motion control,and musculoskeletal *** software systems and a corresponding hardware system are established,aiming at the verification and applications of next-generationbrain-inspired musculoskeletal robots.

关键词： Brain-inspired intelligent robot software and hardware decision making muscle control cognitive intelligence.

来源：评论

学校读者我要写书评

暂无评论

Euler-Discretized GZ-Type Complex Neuronet Computing Real-Time Varying Complex Matrix Inverse 36

Euler-Discretized GZ-Type Complex Neuronet Computing Real-Ti...

引用

第36届中国控制会议

作者： Yunong Zhang Guofu Wu Binbin Qiu Wan Li Penghao He School of Information Science and Technology Sun Yat-sen University(SYSU) Key Laboratory of Autonomous Systems and Networked Control Ministry of Education SYSU-CMU Shunde International Joint Reseach Institute Key Laboratory of Machine Intelligence and Advanced Computing(Sun Yat-sen University) Ministry of Education

ISBN: (纸本)9781538629185

In this paper,a GZ-type complex neuronet（generated by combining gradient dynamic system and Zhang dynamic system） is illustrated and discretized into an Euler-discretized（i.e.,discretized by Euler forward rule） GZ-type complex neuronet for computing real-time varying complex matrix *** results not only show the efficacy of the proposed Eulerdiscretized GZ-type neuronet but also verify that the error pattern is square.

关键词： GZ-Type Neuronet Complex Matrix Inverse Euler Forward Rule Computer Simulation Error Pattern

来源：评论

学校读者我要写书评

暂无评论

An effective background reconstruction method for complicated traffic crossroads

An effective background reconstruction method for complicate...

引用

IEEE International Conference on systems, Man and Cybernetics

作者： Hong Liu Wei Chen Key Laboratory of Machine Perception and Intelligence Key Laboratory of Integrated Micro-System Shenzhen Graduate School Peking University China Key Laboratory of Integrated Micro-System Key Laboratory of Machine Perception and Intelligence Shenzhen Graduate School Peking University China

Effective background reconstruction is the key for real time traffic flow monitoring. High traffic density and complexity of background scene make reconstruction more difficult. Background estimation based on the median method is imprecise under a complex traffic flow condition. In this paper, a new background estimation method based on the similarity of background using parameters of gray mean and variance is proposed. Therefore, a two-dimensional clustering and merging mechanism is introduced. At last, accurate decision about the category of the background is made by analyzing the distribution characteristic of the frame numbers in one category. Our algorithm works on the difficult condition of traffic congestion with higher reliability. The proposed method can be used in background reconstruction of the crossroads based on video sequences.

关键词： Reconstruction algorithms Layout Video sequences Laboratories machine intelligence Image reconstruction Frequency Image motion analysis Gray-scale Clustering algorithms

来源：评论

学校读者我要写书评

暂无评论

An Extended-Isomap for high-dimensional data accuracy and efficiency: a comprehensive survey

引用

Multimedia Tools and Applications 2024年第38期83卷 85523-85574页

作者： Yousaf, Mahwish Shakoor Khan, Muhammad Saadat Ullah, Shamsher Institute of Intelligence Machine Hefei Institutes of Physical Science Chinese Academy of Sciences Anhui Hefei230027 China Key Laboratory of Materials Physics Institute of Solid-State Physics Chinese Academy of Sciences Anhui Hefei230027 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Guangdong Shenzhen518060 China

Manifold learning is a widely adopted nonlinear dimensionality reduction technique employed to discover low-dimensional representations from high-dimensional data and to explore the intrinsic data structure. It encompasses a range of nonlinear techniques, including Isomap, Local Linear Embedding (LLE), Local Tangent Space Alignment (LTSA), and Multidimensional Scaling (MDS), among others. Isomap, as a popular method in manifold learning, has exhibited promising results. However, it encounters several challenges, such as the Topological Stability Problem, Shortest Path Distance, and noise sensitivity, which compromise its accuracy and elevate its computational demands. This survey paper presents three novel existing approaches to address these challenges and enhance the performance of Isomap. Firstly, the FastIsomap method, an existing approach that combines state-of-the-art algorithms like the KD tree and NN-descent to increase graph accuracy while reducing computational cost. Secondly, the FastIsomapVis method, also an existing technique, employs a hierarchical divide-and-conquer strategy employing the KD tree and Dijkstra Buckets Double, which enhances accuracy and reduces computational time in Isomap. Lastly, the NR-Isomap method, another existing approach, used the Local Tangent Space Alignment algorithm to remove noise sensitivity and short-circuit edge problems. The existing methods improve the accuracy of Isomap but also streamline its computational requirements. Furthermore, this survey paper discusses the open issues and future research directions for Isomap and manifold learning methods. It can be a valuable resource for researchers seeking insights across diverse domains. © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2024.

关键词： Clustering algorithms

来源：评论

学校读者我要写书评

暂无评论

Robot-CT Scanning Oriented Synchronous Trajectory Planning of a Dual-Manipulator system 42

Robot-CT Scanning Oriented Synchronous Trajectory Planning o...

引用

42nd Chinese control Conference, CCC 2023

作者： Zhang, Shuaikang Yuan, Mingxing Zhang, Xuebo Institute of Robotics and Automatic Information System College of Artificial Intelligence Nankai University Tianjin Key Laboratory of Intelligent Robotics Tianjin300350 China Key Laboratory of Industrial Internet of Things & Networked Control Ministry of Education Chongqing400065 China

ISBN: (纸本)9789887581543

At present, most CT scanning systems adopt the traditional horizontal O-frame, suspension or C-arm structures, which can not balance the flexibility and functionality. With the development of robot technology, CT scanning systems based on manipulators have gradually emerged. However, limited by the motion accuracy of the manipulator, most researchers sacrifice the flexibility or increase the mass to improve the accuracy. To overcome this limitation, a new master-slave teaching-based scanning method is proposed to improve the scanning accuracy of the dual-manipulator Robot-CT system with the auxiliary function of rigid links. First, a rigid link is employed to connect the end effectors of the two manipulators. Next, the sampled trajectory of each joint of the slave-manipulator is recorded while the master-manipulator pulls the slave-manipulator to perform a circular motion. Finally, when carrying out the scanning, the dual-manilupator system reproduces the recorded joint trajectory without the rigid element, thereby improving the accuracy of the dual-manipulator CT scanning system to achieve a high-accuracy spatiotemporal synchronization and alignment of pose. To this end, a fifth-order spline interpolation is used to interpolate the sampled trajectory of each joint of the slave-manipulator, which allows it to perfectly reproduce the joint trajectory recorded during the teaching process and ensures the smoothness of the angular velocity and acceleration curves. Simulations are investigated and the corresponding results confirm the effectiveness of the trajectory planning method of the slave-manipulator. © 2023 Technical Committee on control Theory, Chinese Association of Automation.

关键词： Manipulators

来源：评论

学校读者我要写书评

暂无评论

Learning-based adaptive estimation for AOA target tracking with non-gaussian white noise

Learning-based adaptive estimation for AOA target tracking w...

引用

2019 IEEE International Conference on Robotics and Biomimetics, ROBIO 2019

作者： Xu, Sheng Ou, Yongsheng Wu, Xinyu Shenzhen Institutes of Advanced Technology CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems China Guangdong Provincial Key Lab of Robotics and Intelligent System Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Shenzhen China

ISBN: (纸本)9781728163215

In angle-of-arrival (AOA) target tracking, the target states are estimated using the noisy angular measurements. The non-Gaussian measurement noise is common in practical applications and will decrease the estimation accuracy significantly. This paper is to reduce the negative impacts of the non-Gaussian white noise (NGWN), which is modeled by multiple mixture Gaussian white noises, and guarantee the estimation accuracy. A learning-based adaptive extended Kalman filter (EKF) for AOA target tracking is developed in the NGWN environment. In the proposed method, the extreme learning machine (ELM) using a three-layer neural network is applied to identify the characters of measurement noise at each sampling time. Consequence, the EKF will consider the noise characters by the trained ELM, and make the corresponding real-time adjustments to improve the tracking performance. The effectiveness of the proposed method is verified by simulation examples. © 2019 IEEE.

关键词： Target tracking

来源：评论

学校读者我要写书评

暂无评论

Modeling based on MOGA and the dynamic Ε -SVM for fermentation process

Modeling based on MOGA and the dynamic Ε -SVM for fermentat...

引用

6th World Congress on Intelligent control and Automation, WCICA 2006

作者： Xuejin, Gao Pu, Wang Chongzheng, Sun Yating, Zhang Huiqing, Zhang Yi, Jianqiang College of Electronic Information and Control Engineering Beijing University of Technology Beijing 100022 China Key Laboratory of Complex System and Intelligence Science Chinese Academy of Sciences Beijing 100033 China

ISBN: (纸本)1424403324

To found the suitable models to describe the behavior of biochemistry systems, the dynamic Ε -SVM method was proposed on the basis of SVM. Each training sample uses different error. The existed methods for selecting the parameters of SVM not only consume time, but also are difficult to find the optimal parameters. The optimal parameters were automatically decided by using multi-object Genetic Algorithm (MOGA). A new modeling method that combined MOGA with the dynamic Ε -SVM was presented. The model for penicillin titer preestimate was developed by it in Matlab6.5 with data collected from real plant. The model possesses the strong capability of fitting and generalization. Experiments show that the dynamic Ε -SVM is superior to the standard SVM modeling method. MOGA is very feasible and efficient too. ©2006 IEEE.

关键词： Fermentation

来源：评论

学校读者我要写书评

暂无评论

Multi-pose moving human detection from a patrol robot in real-time 49

Multi-pose moving human detection from a patrol robot in rea...

引用

49th International Symposium on Robotics, ISR 2017

作者： Wu, Qingtian Guo, Huiwen Key Laboratory of Human-Machine Intelligence Synergic Systems Shenzhen Institutes of Advanced Technology Chinese Acad. of Sci. Guangdong Provincial Key Laboratory of Robotics and Intelligent System China Shenzhen College of Advanced Technology University of Chinese Academy of Sciences China

In this paper, a multi-pose human detection system is presented for a patrol robot in real-time. 20 fps (frame per second) and a satisfying detection accuracy of multi-pose human detection in complex outdoor environments can be achieved in the system with no additional special hardware like GPU (graphics processing unit). First, 30,000 positive samples with various appearances are selected manually from different camera angles and are used to train the convolutional neural network (CNN) classifier. Secondly, optical flow of two successive frames taken by on-board camera is used to extract region of interests (ROIs) and a series of post-processing methods, i.e., average filtering, morphological operation and extraction of outer contour are applied for the real-time requirement. Thirdly, a two-stream CNN combining appearance and motion information are applied to reduce the false detection accuracy. Field experiments in complex outdoor environments have been performed to verify that the proposed system can be used to detect multi-pose humans with high detection accuracy in realtime. © 49th International Symposium on Robotics, ISR 2017. All rights reserved.

关键词： Graphics processing unit

来源：评论

学校读者我要写书评

暂无评论

Nb-embedded Janus WSSe monolayer as a resistive or Schottky gas sensor upon CO, HCHO and C 2 H 3 Cl in dry transformers: a first-principles investigation

引用

Physics Letters A 2025年 553卷

作者： Dan He Guangming Li Wen Cao Hao Cui Key Laboratory of Testing Technology for Manufacturing Process Southwest University of Science and Technology Mianyang 621010 China Intelligent Operation for New Energy Based Power System Qinghai University Xining 810016 China School of Information and Control Engineering Southwest University of Science and Technology Mianyang 621010 China College of Artificial Intelligence Southwest University Chongqing 400715 China

The inevitable insulation defects in dry transformers lead to the decomposition of epoxy resin into CO, HCHO, and C₂H₃Cl. To assess the operational status of such electrical equipment, this study proposes a Nb-embedded Janus WSSe (Nb-WSSe) monolayer on basis of first-principles theory as an outstanding material for typical gas detection. It is found that Nb-WSSe monolayer shows chemisorption towards three gas molecules, with largely tuned electronic property. The charge density difference, band structure, density of states and work function of the gas adsorbed systems are well-analyzed, and the sensing mechanism of Nb-WSSe monolayer for exploration of the resistive and Schottky gas sensors are uncovered. The findings manifest the favorable sensitivity and selectively of Nb-WSSe monolayer for detection of three gas *** findings presented in this study hold significant value, as they possess the potential to catalyze Janus TMDCs-based novel gas sensing candidates for use within the realm of electrical engineering.

关键词： Gas detectors

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：