检索结果-内蒙古大学图书馆

Off-Policy Q-Learning for Anti-Interference control of Multi-Player Systems ⁎

IFAC-PapersOnLine 2020年第2期53卷 9189-9194页

作者： Jinna Li Zhenfei Xiao Tianyou Chai Frank. L. Lewis Sarangapani Jagannathan School of Information and Control Engineering Liaoning Shihua University Fushun 113001 China State Key Laboratory of Synthetical Automation for Process Industries Northeastern University Shenyang 110819 China UTA Research Institute the University of Texas at Arlington Arlington TX 76118 USA Department of Electrical and Computer Engineering Missouri University of Science and Technology Rolla MO 65409 USA

This paper develops a novel off-policy game Q-learning algorithm to solve the anti-interference control problem for discrete-time linear multi-player systems using only data without requiring system matrices to be known. The primary contribution of this paper lies in that the Q-learning strategy employed in the proposed algorithm is implemented in an off-policy policy iteration approach other than on-policy learning due to the well-known advantages of off-policy Q-learning over on-policy Q-learning. All of the players work hard together for the goal of minimizing their common performance index meanwhile defeating the disturbance that tries to maximize the specific performance index, and finally they reach the Nash equilibrium of the game resulting in satisfying disturbance attenuation condition. In order to find the solution to the Nash equilibrium, the anti-interference control problem is first transformed into an optimal control problem. Then an off-policy Q-learning algorithm is proposed in the framework of typical adaptive dynamic programming (ADP) and game architecture, such that control policies of all players can be learned using only measured data. Comparative simulation results are provided to verify the effectiveness of the proposed method.

关键词： H ∞ control off-policy Q-learning game theory Nash equilibrium

来源：评论

学校读者我要写书评

暂无评论

Discrete Fourier Transform based Virtual Constraint control of Powered Ankle-Foot Prosthesis

Discrete Fourier Transform based Virtual Constraint Control ...

引用

International Conference on Robotics and Artificial Intelligence (ICRAI)

作者： Awais Naeem Mohsin Rizwan Hafiz Farhan Maqbool Muhammad Ahsan Ali Raza Syed Abbas Zilqurnain Naqvi Al-Khwarizmi Institute of Computer Science UET Lahore HCR Lab National Center of Robotics and Automation Lahore Pakistan Department of Mechatronics and Control Engineering National Center of Robotics and Automation Lahore Pakistan Department of Mechatronics and Control Engineering UET Lahore Lahore Pakistan

Active prosthetic devices have been controlled using several methods such as Echo control, EMG signal based Position control and Finite State Machine (FSM) based Impedance/Compliance control. This manuscript proposes Virtual Constraint control of active prosthesis which obviates any need for the classification of EMG signals, identification of the gait phase for state switching and potentially avoids an exhaustive procedure for the tuning of impedance parameters. In this paper, a Discrete Fourier Transform (DFT) based Virtual Constraint control is presented to characterize the ankle-foot joint trajectory as a function of the human-inspired phase variable in a unified manner. An optimization-based algorithm is employed for the robust generation of continuously monotonic and linear phase variable for DFT based Virtual Constraint control. The results are generalized across various walking speeds for a specific user during the level ground walking.

关键词：

来源：评论

学校读者我要写书评

暂无评论

How to Teach control System Optimization (A Practical Decompisition Approach for the Optimization of TDOF control Systems)

引用

IFAC-PapersOnLine 2019年第9期52卷 115-120页

作者： Cs. Bányász L. Keviczky R. Bars Institute for Computer Science and Control of the Hungarian Academy of Sciences Department of Automation and Applied Informatics Budapest University of Technology and Economics H-1111 Budapest Kende u 13-17 Hungary

The optimality in a generic two-degree of freedom control system can be decomposed into three major steps, because the control error has three major parts: design-, realizability- and modeling-loss. The second term can be made zero for inverse stable processes only. This decomposition opens new ways for practical optimization of two-degree-of-freedom ( TDOF ) systems and helps the construction of new algorithms for robust identification and control. It is more reasonable to teach the optimization of control systems using these components.

关键词： two-degree-of-freedom control systems performance robustness optimality

来源：评论

学校读者我要写书评

暂无评论

Cloud-Fog automation: The New Paradigm towards Autonomous Industrial Cyber-Physical Systems

arXiv

引用

arXiv 2025年

作者： Jin, Jiong Pang, Zhibo Kua, Jonathan Zhu, Quanyan Johansson, Karl H. Marchenko, Nikolaj Cavalcanti, Dave School of Engineering Swinburne University of Technology HawthornVIC3122 Australia Department of Intelligent Systems KTH Royal Institute of Technology Stockholm10044 Sweden Department of Automation Technology ABB Corporate Research Sweden Västerås72226 Sweden School of Information Technology Deakin University GeelongVIC3220 Australia Department of Electrical and Computer Engineering Tandon School of Engineering New York University BrooklynNY11201 United States Division of Decision and Control Systems School of Electrical Engineering and Computer Science and Digital Futures KTH Royal Institute of Technology Stockholm10044 Sweden Corporate Research Robert Bosch GmbH Renningen71272 Germany Intel Corporation Santa ClaraCA95054 United States

Autonomous Industrial Cyber-Physical Systems (ICPS) represent a future vision where industrial systems achieve full autonomy, integrating physical processes seamlessly with communication, computing and control technologies while holistically embedding intelligence. Cloud-Fog automation is a new digitalized industrial automation reference architecture that has been recently proposed. This architecture is a fundamental paradigm shift from the traditional International Society of automation (ISA)-95 model to accelerate the convergence and synergy of communication, computing, and control towards a fully autonomous ICPS. With the deployment of new wireless technologies to enable almost-deterministic ultra-reliable low-latency communications, a joint design of optimal control and computing has become increasingly important in modern ICPS. It is also imperative that system-wide cyber-physical security are critically enforced. Despite recent advancements in the field, there are still significant research gaps and open technical challenges. Therefore, a deliberate rethink in co-designing and synergizing communications, computing, and control (which we term "3C co-design") is required. In this paper, we position Cloud-Fog automation with 3C co-design as the new paradigm to realize the vision of autonomous ICPS. We articulate the state-of-the-art and future directions in the field, and specifically discuss how goal-oriented communication, virtualization-empowered computing, and Quality of Service (QoS)-aware control can drive Cloud-Fog automation towards a fully autonomous ICPS, while accounting for system-wide cyber-physical security. © 2025, CC BY-SA.

关键词： computer control

来源：评论

学校读者我要写书评

暂无评论

Cloud-Fog automation: The New Paradigm towards Autonomous Industrial Cyber-Physical Systems

引用

IEEE Journal on Selected Areas in Communications 2025年

作者： Jin, Jiong Pang, Zhibo Kua, Jonathan Zhu, Quanyan Johansson, Karl H. Marchenko, Nikolaj Cavalcanti, Dave Swinburne University of Technology School of Engineering HawthornVIC3122 Australia KTH Royal Institute of Technology Department of Intelligent Systems Stockholm10044 Sweden ABB Corporate Research Sweden Department of Automation Technology Västerås72226 Sweden Deakin University School of Information Technology GeelongVIC3220 Australia New York University Tandon School of Engineering Department of Electrical and Computer Engineering BrooklynNY11201 United States KTH Royal Institute of Technology Division of Decision and Control Systems School of Electrical Engineering and Computer Science and Digital Futures Stockholm10044 Sweden Robert Bosch GmbH Corporate Research Renningen71272 Germany Intel Corporation Santa ClaraCA95054 United States

关键词： computer control

来源：评论

学校读者我要写书评

暂无评论

Optimize Student Learning via Random Forest-Based Adaptive Narrative Game

Optimize Student Learning via Random Forest-Based Adaptive N...

引用

IEEE International Conference on automation Science and Engineering (CASE)

作者： Ryan Hare Ying Tang Wei Cui Joleen Liang Department of Electrical and Computer Engineering Rowan University Glassboro USA State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China Institute of Smart Education Qingdao Academy of Intelligent Industries Qingdao China Squirrel AI Learning Shanghai China

ISBN: (数字)9781728169040

ISBN: (纸本)9781728169057

This paper presents an adaptive narrative game system that focuses on sequential logic design. The system adapts a random forest machine learning model to estimate a student's current level of domain knowledge relative to the problem presented to him through his game-playing behavior data, such as time taken to find solutions, errors in solutions, and emotional indicators. Hints, prompts, and/or individualized lessons are then offered to the player to guide their learning in a positive and productive direction. Our preliminary pilot study demonstrates that the model can make accurate classifications, from which proper assistance can then be provided to individual students as they play.

关键词： Games Databases Forestry Education Problem-solving Presses Artificial intelligence

来源：评论

学校读者我要写书评

暂无评论

Preface

Lecture Notes in Networks and Systems

引用

Lecture Notes in Networks and Systems 2023年 764 LNNS卷 v-vi页

作者： Milrad, Marcelo Otero, Nuno Sánchez-Gómez, María Cruz Mena, Juan José Durães, Dalila Sciarrone, Filippo Alvarez-Gómez, Claudio Rodrigues, Manuel Vittorini, Pierpaolo Gennari, Rosella Di Mascio, Tania Temperini, Marco De la Prieta, Fernando Linnaeus University Växjö Sweden University of Greenwich London United Kingdom Department of Didactics Organization and Research Method University of Salamanca Salamanca Spain University of Minho Braga Portugal Mercatorum University Rome Italy Facultad de Ingeniería y Ciencias Aplicadas Universidad de los Andes Santiago Chile Department of Life Health and Environmental Sciences University of L’Aquila L’Aquila Italy Faculty of Computer Science Free University of Bozen-Bolzano Bolzano Italy Department of Information Engineering Computer Science and Mathematics University of L’Aquila L’Aquila Italy Dipartimento di Ingegneria Informatica Sapienza Universita’ di Roma Rome Italy Department of Computer Science and Automation Control University of Salamanca Salamanca Spain

来源：评论

学校读者我要写书评

暂无评论

Extensions of the open-source framework Aerostack 3.0 for the development of more interactive flights between UAVs

Extensions of the open-source framework Aerostack 3.0 for th...

引用

International Conference on Unmanned Aircraft Systems (ICUAS)

作者： Wojciech Giernacki Jacek Cieślak Martin Molina Pascual Campoy Institute of Robotics and Machine Intelligence Faculty of Control Robotics and Electrical Engineering Poznan University of Technology Poznań Poland Department of Artificial Intelligence Technical University of Madrid (UPM) Madrid Spain Computer Vision and Aerial Robotics (CVAR) Centre for Automation and Robotics Technical University of Madrid (UPM) Madrid Spain

ISBN: (数字)9781728142784

ISBN: (纸本)9781728142791

The basis for properly verified R&D works is to provide reliable prototyping tools at three most important stages: computer simulation, laboratory tests and real-world experiments. In the laboratory-limited conditions, particular importance is attributed to the first two stages, especially in the context of the safety development of autonomous flights of unmanned aerial vehicle (UAV) groups in various missions. The open-source framework Aerostack support those needs and its effectiveness has been proven in the International Micro Air Vehicle Indoor Competitions (IMAV 2013, 2016, 2017) and Mohammed Bin Zayed International Robotics Challenge (MBZIRC 2020). In the paper, the exemplary functionalities for the new version of Aerostack Version 3.0 Distribution Sirocco (Aerial robotics framework for the industry), extended additionally with a library of new behaviors, are presented. The mission of UAVs can be developed fast and effectively in order to conduct test flights with real drones in lab, before one will decide to fly autonomously outdoor. The representative results obtained for low-cost *** 2.0 UAV models in two missions, are presented. The first mission is autonomous patrolling the area by a pair of UAVs, the second - intercepting the intruder in guarded area by the guard UAV.

关键词： Robots Trajectory Drones Libraries Software computer architecture

来源：评论

学校读者我要写书评

暂无评论

Conceptual Foundations of the Use of Formal Models and Methods for the Rapid Creation of Web Applications

Conceptual Foundations of the Use of Formal Models and Metho...

引用

IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems

作者： Sergii Telenyk Grzegorz Nowakowski Eduard Zharikov Jewhenii Vovk Department of Theoretical Electrical Engineering and Computer Science Faculty of Electrical and Computer Engineering Cracow University of Technology Department of Automatic Control and Information Technology Faculty of Electrical and Computer Engineering Cracow University of Technology Department of Automation and Control in Technical Systems National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute"

ISBN: (纸本)9781728140704

The problem of the rapid creation of effective web applications of one class using formal means is considered. A conceptual approach to its solution is offered based on an analysis of the peculiarities of the construction of web applications. Our approach is based on defining the standard web application architecture and selecting its components using formal methods in accordance with user requirements. A formal logical system is proposed that uses the design of web applications as a process of outputting a formula specified according to the needs of the user, which defines the schemes of execution of the modules of the system. An important feature of this approach is the ability to visualise the process of designing the system in 3D, which creates the conditions for effective interaction between developers and machine development tools.

关键词： Web-applications Application construction Business processes Mathematical logic web applications Mathematical logic conceptual User needs Developers

来源：评论

学校读者我要写书评

暂无评论

Resonant beam communications with echo interference elimination

arXiv

引用

arXiv 2021年

作者： Xiong, Mingliang Liu, Qingwen Wang, Gang Giannakis, Georgios B. Zhang, Sihai Zhu, Jinkang Huang, Chuan College of Electronics and Information Engineering Tongji University Shanghai201804 China State Key Lab of Intelligent Control and Decision of Complex Systems School of Automation Beijing Institute of Technology Beijing100081 China Department of Electrical and Computer Engineering University of Minnesota MinneapolisMN55455 United States Key Lab of Wireless-Optical Communications University of Science and Technology of China Hefei Anhui230026 China School of Science and Engineering Chinese University of Hong Kong Shenzhen Guangdong518172 Hong Kong

Resonant beam communications (RBCom) is capable of providing wide bandwidth when using light as the carrier. Besides, the RBCom system possesses the characteristics of mobility, high signal-to-noise ratio (SNR), and multiplexing. Nevertheless, the channel of the RBCom system is distinct from other light communication technologies due to the echo interference issue. In this paper, we reveal the mechanism of the echo interference and propose the method to eliminate the interference. Moreover, we present an exemplary design based on frequency shifting and optical filtering, along with its mathematic model and performance analysis. The numerical evaluation shows that the channel capacity is greater than 15 bit/s/Hz. Copyright © 2021, The Authors. All rights reserved.

关键词： Internet of things

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：