检索结果-内蒙古大学图书馆

Value Iteration-Based Distributed Adaptive Dynamic Programming for Multi-Player Differential Game With Incomplete information

引用

IEEE/CAA Journal of Automatica Sinica 2025年第2期12卷 436-447页

作者： Yun Zhang Yuqi Wang Yunze Cai the Department of Automation Shanghai Jiao Tong University the Key Laboratory of System Control and Information Processing Ministry of Education of China the National Key Laboratory of Air-based Information Perception and Fusion

In this paper, a distributed adaptive dynamic programming(ADP) framework based on value iteration is proposed for multi-player differential games. In the game setting,players have no access to the information of others' system parameters or control laws. Each player adopts an on-policy value iteration algorithm as the basic learning framework. To deal with the incomplete information structure, players collect a period of system trajectory data to compensate for the lack of information. The policy updating step is implemented by a nonlinear optimization problem aiming to search for the proximal admissible policy. Theoretical analysis shows that by adopting proximal policy searching rules, the approximated policies can converge to a neighborhood of equilibrium policies. The efficacy of our method is illustrated by three examples, which also demonstrate that the proposed method can accelerate the learning process compared with the centralized learning framework.

关键词： Distributed adaptive dynamic programming incomplete information multi-player differential game (MPDG) value iteration

来源：评论

学校读者我要写书评

暂无评论

Decentralized fault diagnosis of discrete-event systems with unreliable sensors using linear temporal logic

引用

Science china(information Sciences) 2025年第1期68卷 322-341页

作者： Weijie DONG Shaoyuan LI Xiang YIN Key Laboratory of System Control and Information Processing Ministry of EducationDepartment of Automation Shanghai Jiao Tong University

In this paper,we investigate a decentralized diagnosis problem of a discrete-evnt system(DES) subject to unreliable sensors,where the sensor observations of local diagnosers may be non-deterministic as a result of possible *** studies on decentralized robust diagnosis can only deal with different types of sensor failures separately,e.g.,all sensors suffer from the same type of sensor failures such as intermittent sensor failures or permanent sensor ***,since sensors of different local diagnosers may face different external environments and have different internal characteristics,sensors corresponding to different local diagnosers may also have their own fault *** this paper,we propose a flexible framework of decentralized diagnosis for DES subject to unreliable sensors such that sensors of different local diagnosers are permitted to have different types of sensor *** this end,we extend the existing decentralized diagnosis framework to the case where there exist common sensors broadcasting their observations to all local *** apply linear temporal logic(LTL) to constrain infinite behaviors of private sensors of local diagnosers and common ***,a new notion of φ-codiagnosability is proposed as the necessary and sufficient condition for the existence of a decentralized diagnoser that works correctly under sensors,satisfying LTL-based sensor ***,we provide an effective approach to verify the φ-codiagnosability.

关键词： discrete event systems decentralized diagnosis codiagnosability automata

来源：评论

学校读者我要写书评

暂无评论

Value Iteration-Based Cooperative Adaptive Optimal control for Multi-Player Differential Games With Incomplete information

引用

IEEE/CAA Journal of Automatica Sinica 2024年第3期11卷 690-697页

作者： Yun Zhang Lulu Zhang Yunze Cai the Department of Automation Shanghai Jiao Tong UniversityShanghai 200240 the Key Laboratory of System Control and Information Processing Ministry of Education of ChinaShanghai 200240China

This paper presents a novel cooperative value iteration(VI)-based adaptive dynamic programming method for multi-player differential game models with a convergence *** players are divided into two groups in the learning process and adapt their policies *** method removes the dependence of admissible initial policies,which is one of the main drawbacks of the PI-based ***,this algorithm enables the players to adapt their control policies without full knowledge of others’ system parameters or control *** efficacy of our method is illustrated by three examples.

关键词： Adaptive dynamic programming incomplete information multi-player differential game value iteration

来源：评论

学校读者我要写书评

暂无评论

Optimal Deceptive Strategy Synthesis for Autonomous systems under Asymmetric information

IEEE Transactions on Intelligent Vehicles

引用

IEEE Transactions on Intelligent Vehicles 2024年 1-14页

作者： Lv, Peng Li, Shaoyuan Yin, Xiang Department of Automation and Key Laboratory of System Control and Information Processing Shanghai Jiao Tong University Shanghai China

High-level task planning under adversarial environments is one of the central problems in the development of autonomous systems such as unmanned ground vehicles (UGV). Existing works commonly assume that the decision-maker such as UAV shares the same information with the environment. However, in many scenarios, the UGV, as an integral part of the system, generally has more information than the external adversary. For such a scenario, the decision-maker with more information may achieve better performance by using deceptive strategies. In this paper, we investigate the problem of optimal deceptive strategy synthesis for autonomous systems under asymmetric information between the internal decision-maker and the external adversary. Specifically, we model the dynamic system as a weighted two-player graph game and the objective is to optimize the mean payoff value per task. To capture the asymmetric information between two parties, we assume that the UGV has complete knowledge of the system, whereas the adversary may have misconceptions regarding the task as well as the cost. To synthesize an optimal deceptive strategy, we propose a synthesis algorithm based on hyper-games. The correctness as well as the complexity of the algorithm are analyzed. We illustrate the proposed algorithm by running examples as well as a simulation case study. Finally, we conduct an empirical experiment using real-world scenarios to verify the practical applicability of our algorithm. IEEE

关键词： Intelligent vehicle highway systems

来源：评论

学校读者我要写书评

暂无评论

Cognitive Navigation for Intelligent Mobile Robots:A Learning-Based Approach With Topological Memory Configuration

引用

IEEE/CAA Journal of Automatica Sinica 2024年第9期11卷 1933-1943页

作者： Qiming Liu Xinru Cui Zhe Liu Hesheng Wang Department of Automation Shanghai Jiao Tong UniversityShanghai 200240China MoE Key Laboratory of Artificial Intelligence AI InstituteShanghai Jiao Tong UniversityShanghai 200240China Department of Automation Key Laboratory of System Control and Information Processing of Ministry of EducationKey Laboratory of Marine Intelligent Equipment and System of Ministry of EducationShanghai Engineering Research Center of Intelligent Control and ManagementShanghai Jiao Tong UniversityShanghai 200240China

Autonomous navigation for intelligent mobile robots has gained significant attention,with a focus on enabling robots to generate reliable policies based on maintenance of spatial *** this paper,we propose a learning-based visual navigation pipeline that uses topological maps as memory *** introduce a unique online topology construction approach that fuses odometry pose estimation and perceptual similarity *** tackles the issues of topological node redundancy and incorrect edge connections,which stem from the distribution gap between the spatial and perceptual ***,we propose a differentiable graph extraction structure,the topology multi-factor transformer(TMFT).This structure utilizes graph neural networks to integrate global memory and incorporates a multi-factor attention mechanism to underscore elements closely related to relevant target cues for policy *** from photorealistic simulations on image-goal navigation tasks highlight the superior navigation performance of our proposed pipeline compared to existing memory *** validation through behavior visualization,interpretability tests,and real-world deployment further underscore the adapt-ability and efficacy of our method.

关键词： Graph neural networks(GNNs) spatial memory topological map visual navigation

来源：评论

学校读者我要写书评

暂无评论

Strip width spread prediction in rough rolling process based on mechanism modeling and optimization

引用

Journal of Iron and Steel Research International 2023年第12期30卷 2416-2424页

作者： Yan-jiu Zhong Jing-cheng Wang Jia-hui Xu Jun Rao Department of Automation Key Laboratory of System Control and Information ProcessingShanghai Jiao Tong UniversityShanghai 200240China

Aiming at the problems of low accuracy and poor robustness that existed in the current hot rolling strip width spread model,an improved strip spread prediction model based on a material forming mechanism and Bayesian optimized adaptive differential evolution algorithm(BADE)was *** first,we improved the original spread mechanism model by adding the weight and bias term to enhance the model robustness based on rolling ***,the BADE algorithm was proposed to optimize the improved spread mechanism *** optimization algorithm is based on a novel adaptive differential evolution algorithm,which can effectively achieve the global optimal ***,the prediction performances of five machine learning algorithms were compared in *** results show that the prediction accuracy of the improved spread model is obviously better than that of the machine learning algorithms,which proves the effectiveness of the proposed method.

关键词： Hot rolling Width spread prediction Bayesian optimization:Adaptive differential evolution Parameter optimization

来源：评论

学校读者我要写书评

暂无评论

Boosting Explore-Exploit Behavior for Navigating Vehicle by Maintaining Informative Topological Frontier

IEEE Transactions on Intelligent Vehicles

引用

IEEE Transactions on Intelligent Vehicles 2024年 1-11页

作者： Liu, Qiming Cui, Xinru Liu, Zhe Wang, Hesheng Department of Automation Shanghai Jiao Tong University Shanghai China MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University Shanghai China Department of Automation Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Engineering Research Center of Intelligent Control and Management Shanghai Jiao Tong University Shanghai China

Target search in unknown environments places high demands not only on an autonomous vehicle's ability to perceive and interpret target cues, but also on its conscious of collecting these cues by active exploration. While existing navigation methods have successfully built target-driven policies by maintaining memory of explored areas, there has been a lack of focus on facilitating target-aware exploration-the informative frontier information at unexplored yet visible areas is often overlooked. In this paper, we introduce a novel topology-based memory structure, Frontier-enhanced Topological Memory (FTM), and a Hierarchical Topology Encoding and Extraction (HTEE) module, fostering the autonomous vehicle's awareness of both environmental exploration and target approach. Specifically, FTM innovatively incorporates informative ghost nodes on traditional topological map to represent unexplored yet visible regions. We leverage an online-trained implicit scene representation to estimate the positions and generate features of these ghost nodes. The HTEE then employs implicit graph convolutions and attention mechanisms to extract cognitive information from FTM, taking into account the hierarchical memory structure, target cues, and current state. Our design bolsters cognitive navigation decisions. The experiments in the high-fidelity environments, including performance tests, visualizations, and interpretability experiments, validate the effectiveness of our approach in enhancing the vehicle's exploratory behavior. The improved exploration awareness for target cue collection, in turn, enhances the success rate and path efficiency of target search. Furthermore, we demonstrate the adaptability of our algorithm in real-world physical environments. IEEE

关键词： Data mining

来源：评论

学校读者我要写书评

暂无评论

Distributed Economic MPC for Synergetic Regulation of the Voltage of an Island DC Micro-Grid

引用

IEEE/CAA Journal of Automatica Sinica 2024年第3期11卷 734-745页

作者： Yi Zheng Yanye Wang Xun Meng Shaoyuan Li Hao Chen IEEE the Department of Automation Shanghai Jiao Tong UniversityShanghai 200240 the Key Laboratory of System Control and Information Processing Ministry of Education of ChinaShanghai 200240China Haixi Institutes Chinese Academy of SciencesJinjiang 362216China

In this paper,distributed model predictive control(DMPC) for island DC micro-grids(MG) with wind/photovoltaic(PV)/battery power is proposed,which coordinates all distributed generations(DG) to stabilize the bus voltage together with the insurance of having computational efficiency under a real-time *** on the feedback of the bus voltage,the deviation of the current is dispatched to each DG according to cost over the prediction ***,to avoid the excessive fluctuation of the battery power,both the discharge-charge switching times and costs are considered in the model predictive control(MPC) optimization problems.A Lyapunov constraint with a time-varying steady-state is designed in each local MPC to guarantee the stabilization of the entire *** voltage stabilization of the MG is achieved by this strategy with the cooperation of *** numeric results of applying the proposed method to a MG of the Shanghai Power Supply Company shows the effectiveness of the distributed economic MPC.

关键词： Distributed model predictive control(DMPC) Lyapunovbased model predictive control micro-grid(MG) voltage control

来源：评论

学校读者我要写书评

暂无评论

Safety-Aware Scheduling of Real-Time control systems With Burst Computing Tasks

IEEE Transactions on Industrial Cyber-Physical Systems

引用

IEEE Transactions on Industrial Cyber-Physical systems 2025年 3卷 218-227页

作者： Cheng, Ting Liang, Yonghui Li, Hui Xu, Qimin Zhu, Shanying Shanghai Jiao Tong University Department of Automation Shanghai200240 China Ministry of Education of China Key Laboratory of System Control and Information Processing Shanghai200240 China

This paper investigates the safety-aware task scheduling problem of real-time control systems in the presence of burst computing tasks. The basic idea is to adaptively release resources from low-criticality control tasks, ensuring timely completion of burst computing tasks and keeping the control system state within a safe threshold. An efficient algorithm called ADP-Opt is proposed to solve the problem. It first decouples the complex original problem into multiple subproblems, which greatly reduces the search space and improves the solution efficiency. In the subproblem, safety is maintained by limiting the upper bound of the system state's deviation to below the threshold. By introducing a penalty term in the cost function related to computing resources, we aim to balance the impact of control computing tasks on control performance and the consumption of computing resources. Consequently, the overall cost of the control system can be minimized while releasing enough resources for burst computing tasks. Simulation results show that the scheduling decisions made by ADP-Opt approach the optimal decision and maintain the safety of the control systems. © 2023 IEEE.

关键词： Real time control

来源：评论

学校读者我要写书评

暂无评论

controllability of heterogeneous networked sampled-data systems

引用

Science china(information Sciences) 2025年第3期68卷 302-318页

作者： Zixuan YANG Lin WANG Xiaofan WANG Guanrong CHEN Department of Automation Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China School of Mechatronic Engineering and Automation Shanghai University School of Electrical and Electronic Engineering Shanghai Institute of Technology Department of Electrical Engineering City University of Hong Kong

This study investigates the controllability of a general heterogeneous networked sampled-data system(HNSS) consisting of nonidentical node systems, where the inner coupling between any pair of nodes can be described by a unique *** signals on control and transmission channels are sampled and held by zero-order holders, and the control sampling period of each node can be different. Necessary and sufficient controllability conditions are developed for the general HNSS, using the Smith normal form and matrix equations, respectively. The HNSS in specific topology or dynamic settings is discussed subsequently with easier-to-verify conditions derived. These heterogeneous factors have been determined to independently or jointly affect the controllability of networked sampled-data systems. Notably, heterogeneous sampling periods have the potential to enhance the overall controllability, but not for systems with some special dynamics. When the node dynamics are heterogeneous,the overall system can be controllable even if it is topologically uncontrollable. In addition, in several typical heterogeneous sampled-data multi-agent systems, pathological sampling of single-node systems will necessarily cause overall uncontrollability.

关键词： network controllability sampled-data system heterogeneous system inner coupling multi-agent system

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：