检索结果-内蒙古大学图书馆

Development of a Bias Compensating Q-Learning controller for a Multi-Zone HVAC Facility

IEEE/CAA Journal of Automatica Sinica 2023年第8期10卷 1704-1715页

作者： Syed Ali Asad Rizvi Amanda J.Pertzborn Zongli Lin IEEE the Department of Electrical and Computer Engineering Tennessee Technological UniversityCookevilleTN 38505 USA the Mechanical Systems and Controls Group in the Building Energy and Environment Division at the National Institute of Standards and Technology(NIST) GaithersburgMD 20899 USA the Charles L.Brown Department of Electrical and Computer Engineering University of VirginiaCharlottesvilleVA 22904-4743 USA

We present the development of a bias compensating reinforcement learning(RL)algorithm that optimizes thermal comfort(by minimizing tracking error)and control utilization(by penalizing setpoint deviations)in a multi-zone heating,ventilation,and air-conditioning(HVAC)lab facility subject to unmeasurable disturbances and unknown *** is shown that the presence of unmeasurable disturbance results in an inconsistent learning equation in traditional RL controllers leading to parameter estimation bias(even with integral action support),and in the extreme case,the divergence of the learning *** demonstrate this issue by applying the popular Q-learning algorithm to linear quadratic regulation(LQR)of a multi-zone HVAC environment and showing that,even with integral support,the algorithm exhibits bias issue during the learning phase when the HVAC disturbance is unmeasurable due to unknown heat gains,occupancy variations,light sources,and outside weather *** address this difficulty,we present a bias compensating learning equation that learns a lumped bias term as a result of disturbances(and possibly other sources)in conjunction with the optimal control *** results show that the proposed scheme not only recovers the bias-free optimal control parameters but it does so without explicitly learning the dynamic model or estimating the disturbances,demonstrating the effectiveness of the algorithm in addressing the above challenges.

关键词： HVAC control optimal tracking Q-learning reinforcement learning(RL)

来源：评论

学校读者我要写书评

暂无评论

Multiagent Consensus over Time-Invariant and Time-Varying Signed Digraphs via Eventual Positivity

引用

IEEE Transactions on Automatic control 2023年第9期68卷 5429-5444页

作者： Fontan, Angela Wang, Lingfei Hong, Yiguang Shi, Guodong Altafini, Claudio Linköping University Division of Automatic Control Department of Electrical Engineering LinköpingSE-58183 Sweden KTH Royal Institute of Technology Division of Decision and Control Systems StockholmSE-10044 Sweden Chinese Academy of Sciences Key Laboratory of Systems and Control Academy of Mathematics and Systems Science Beijing100190 China University of Chinese Academy of Sciences Beijing100190 China Tongji University Department of Control Science and Engineering Shanghai201804 China University of Sydney Australian Center for Field Robotics School of Aerospace Mechanical and Mechatronic Engineering SydneyNSW2008 Australia

Laplacian dynamics on signed digraphs have a richer behavior than those on nonnegative digraphs. In particular, for the so-called 'repelling' signed Laplacians, the marginal stability property (needed to achieve consensus) is not guaranteed a priori and, even when it holds, it does not automatically lead to consensus, as these signed Laplacians may lose rank even in strongly connected digraphs. Furthermore, in the time-varying case, instability can occur even when switching in a family of systems each of which corresponds to a marginally stable signed Laplacian with the correct corank. In this article, we present novel conditions for achieving consensus on signed digraphs based on the property of eventual positivity, a Perron-Frobenius (PF) type of property for signed matrices. The conditions we develop cover both time-invariant and time-varying cases. A particularly simple sufficient condition, valid in both cases, is that the Laplacians are normal matrices. Such condition can be relaxed in several ways. For instance, in the time-invariant case it is enough that the Laplacian has this PF property on the right side, but not on the left side (i.e., on the transpose). For the time-varying case, convergence to consensus can be guaranteed by the existence of a common Lyapunov function for all the signed Laplacians. All conditions can be easily extended to bipartite consensus. © 1963-2012 IEEE.

关键词： Lyapunov functions

来源：评论

学校读者我要写书评

暂无评论

Learning Communities from Equilibria of Nonlinear Opinion Dynamics 63

Learning Communities from Equilibria of Nonlinear Opinion Dy...

引用

63rd IEEE Conference on Decision and control, CDC 2024

作者： Xing, Yu Bizyaeva, Anastasia Johansson, Karl H. Kth Royal Institute of Technology and with Digital Futures Division of Decision and Control Systems School of Electrical Engineering and Computer Science Stockholm Sweden Cornell University Sibley School of Mechanical and Aerospace Engineering IthacaNY United States

ISBN: (纸本)9798350316339

This paper studies community detection for a nonlinear opinion dynamics model from its equilibria. It is assumed that the underlying network is generated from a stochastic block model with two communities, where agents are assigned with community labels and edges are added independently based on these labels. Agents update their opinions following a nonlinear rule that incorporates saturation effects on interactions. It is shown that clustering based on a single equilibrium can detect most community labels (i.e., achieving almost exact recovery), if the two communities differ in size and link probabilities. When the two communities are identical in size and link probabilities, and the intercommunity connections are denser than intra-community ones, the algorithm can achieve almost exact recovery under negative influence weights but fails under positive influence weights. Utilizing fixed point equations and spectral methods, we also propose a detection algorithm based on multiple equilibria, which can detect communities with positive influence weights. Numerical experiments demonstrate the performance of the proposed algorithms. © 2024 IEEE.

关键词： Nash equilibrium

来源：评论

学校读者我要写书评

暂无评论

Observer-Based control of Second-Order Multi-vehicle systems in Bearing-Persistently Exciting Formations 63

Observer-Based Control of Second-Order Multi-vehicle Systems...

引用

63rd IEEE Conference on Decision and control, CDC 2024

作者： Tang, Zhiqi Fidan, Baris Johansson, Karl H. Martensson, Jonas Hamel, Tarek Kth Royal Institute of Technology Division of Decision and Control Systems School of Electrical Engineering and Computer Science StockholmSE-10044 Sweden University of Waterloo Mechanical and Mechatronics Engineering Department ON Canada I3S-UCA Cnrs France

ISBN: (纸本)9798350316339

This paper proposes an observer-based formation tracking control approach for multi-vehicle systems with second-order motion dynamics, assuming that vehicles' relative or global position and velocity measurements are unavailable. It is assumed that all vehicles are equipped with sensors capable of sensing the bearings relative to neighboring vehicles and only one leader vehicle has access to its global position. Each vehicle estimates its absolute position and velocity using relative bearing measurements and the estimates of neighboring vehicles received over a communication network. A distributed observer-based controller is designed, relying only on bearing and acceleration measurements. This work further explores the concept of the Bearing Persistently Exciting (BPE) formation by proposing new algorithms for bearing-based localization and state estimation of second-order systems in centralized and decentralized manners. It also examines conditions on the desired formation to guarantee the exponential stability of distributed observer-based formation tracking controllers. In support of our theoretical results, some simulation results are presented to illustrate the performance of the proposed observers as well as the observer-based tracking controllers. © 2024 IEEE.

关键词： Acceleration measurement

来源：评论

学校读者我要写书评

暂无评论

Risk-Aware Real-Time Task Allocation for Stochastic Multi-Agent systems under STL Specifications

arXiv

引用

arXiv 2024年

作者： Engelaar, Maico H.W. Zhang, Zengjie Vlahakis, Eleftherios E. Dimarogonas, Dimos V. Lazar, Mircea Haesaert, Sofie Department of Electrical Engineering Control Systems Group Eindhoven University of Technology Netherlands Division of Decision and Control Systems School of Electrical Engineering and Computer Science KTH Royal Institute of Technology Sweden

This paper addresses the control synthesis of heterogeneous stochastic linear multi-agent systems with real-time allocation of signal temporal logic (STL) specifications. Based on previous work, we decompose specifications into sub-specifications on the individual agent level. To leverage the efficiency of task allocation, a heuristic filter evaluates potential task allocation based on STL robustness, and subsequently, an auctioning algorithm determines the definitive allocation of specifications. Finally, a control strategy is synthesized for each agent-specification pair using tube-based model predictive control (MPC), ensuring provable probabilistic satisfaction. We demonstrate the efficacy of the proposed methods using a multi-shuttle scenario that highlights a promising extension to automated driving applications like vehicle routing. © 2024, CC BY-NC-ND.

关键词： Stochastic systems

来源：评论

学校读者我要写书评

暂无评论

Risk-Aware Real-Time Task Allocation for Stochastic Multi-Agent systems under STL Specifications

Risk-Aware Real-Time Task Allocation for Stochastic Multi-Ag...

引用

IEEE Conference on Decision and control

作者： M. H. W. Engelaar Z. Zhang E. E. Vlahakis D.V. Dimarogonas M. Lazar S. Haesaert Department of Electrical Engineering (Control Systems Group) Eindhoven University of Technology The Netherlands Division of Decision and Control Systems School of Electrical Engineering and Computer Science KTH Royal Institute of Technology Sweden

ISBN: (数字)9798350316339

ISBN: (纸本)9798350316346

This paper addresses the control synthesis of heterogeneous stochastic linear multi-agent systems with realtime allocation of signal temporal logic (STL) specifications. Based on previous work, we decompose specifications into subspecifications on the individual agent level. To leverage the efficiency of task allocation, a heuristic filter evaluates potential task allocation based on STL robustness, and subsequently, an auctioning algorithm determines the definitive allocation of specifications. Finally, a control strategy is synthesized for each agent-specification pair using tube-based model predictive control (MPC), ensuring provable probabilistic satisfaction. We demonstrate the efficacy of the proposed methods using a multi-shuttle scenario that highlights a promising extension to automated driving applications like vehicle routing.

关键词： Vehicle routing Stochastic processes Probabilistic logic Prediction algorithms Real-time systems Robustness Resource management Vehicle dynamics Multi-agent systems Predictive control

来源：评论

学校读者我要写书评

暂无评论

Explaining complex systems: a tutorial on transparency and interpretability in machine learning models (part II)

引用

IFAC-PapersOnLine 2024年第15期58卷 497-501页

作者： Donatello Materassi Sean Warnick Cristian Rojas Maarten Schoukens Elizabeth Cross Department of Electrical and Computer Engineering University of Minnesota US Department of Homeland Security Science and Technology Directorate EECS/Division of Decision and Control Systems KTH Royal Institute of Technology Control Systems Group Eindhoven University of Technology Eindhoven The Netherlands Department of Mechanical Engineering University of Sheffield

In the second segment of the tutorial, we transition from the granularity of local interpretability to a broader exploration of eXplainable AI (XAI) methods. Building on the specific focus of the first part, which delved into Local Interpretable Model-Agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP), this section takes a more expansive approach. We will navigate through various XAI techniques of more global nature, covering counterfactual explanations, equation discovery, and the integration of physics-informed AI. Unlike the initial part, which concentrated on two specific methods, this section offers a general overview of these broader classes of techniques for explanation. The objective is to provide participants with a comprehensive understanding of the diverse strategies available for making complex machine learning models interpretable on a more global scale.

关键词： eXplainable AI

来源：评论

学校读者我要写书评

暂无评论

Learning Flow Functions from Data with Applications to Nonlinear Oscillators

引用

IFAC-PapersOnLine 2023年第2期56卷 4088-4093页

作者： Miguel Aguiar Amritam Das Karl H. Johansson Division of Decision and Control Systems and Digital Futures KTH Royal Institute of Technology Stockholm Sweden Control Systems Group Dept. of Electrical Engineering Eindhoven University of Technology Eindhoven Netherlands

We describe a recurrent neural network (RNN) based architecture to learn the flow function of a causal, time-invariant and continuous-time control system from trajectory data. By restricting the class of control inputs to piecewise constant functions, we show that learning the flow function is equivalent to learning the input-to-state map of a discrete-time dynamical system. This motivates the use of an RNN together with encoder and decoder networks which map the state of the system to the hidden state of the RNN and back. We show that the proposed architecture is able to approximate the flow function by exploiting the system's causality and time-invariance. The output of the learned flow function model can be queried at any time instant. We experimentally validate the proposed method using models of the Van der Pol and FitzHugh-Nagumo oscillators. In both cases, the results demonstrate that the architecture is able to closely reproduce the trajectories of these two systems. For the Van der Pol oscillator, we further show that the trained model generalises to the system's response with a prolonged prediction time horizon as well as control inputs outside the training distribution. For the FitzHugh-Nagumo oscillator, we show that the model accurately captures the input-dependent phenomena of excitability.

关键词： Oscillator Learning Recurrent Neural Network Excitability

来源：评论

学校读者我要写书评

暂无评论

A Multi-Player Potential Game Approach for Sensor Network Localization with Noisy Measurements 63

A Multi-Player Potential Game Approach for Sensor Network Lo...

引用

63rd IEEE Conference on Decision and control, CDC 2024

作者： Xu, Gehui Chen, Guanpu Fidan, Baris Hong, Yiguang Qi, Hongsheng Parisini, Thomas Johansson, Karl H. Kth Royal Institute of Technology Division of Decision and Control Systems School of Electrical Engineering and Computer Science Stockholm100 44 Sweden University of Waterloo Department of Mechanical and Mechatronics Engineering WaterlooONN2L 3G1 Canada Tongji University Department of Control Science and Engineering shanghai201804 China Shanghai Research Institute for Intelligent Autonomous Systems Shanghai201210 China Key Laboratory of Systems and Control Academy of Mathematics and Systems Science Beijing China University of Chinese Academy of Sciences School of Mathematical Sciences Beijing China Aalborg University Department of Electronic Systems Denmark Imperial College London Department of Electrical and Electronic Engineering LondonSW7 2AZ United Kingdom University of Trieste Department of Engineering and Architecture Italy

ISBN: (纸本)9798350316339

Sensor network localization (SNL) is a challenging problem due to its inherent non-convexity and the effects of noise in inter-node ranging measurements and anchor node position. We formulate a non-convex SNL problem as a multiplayer non-convex potential game and investigate the existence and uniqueness of a Nash equilibrium (NE) in both the ideal setting without measurement noise and the practical setting with measurement noise. We first show that the NE exists and is unique in the noiseless case, and corresponds to the precise network localization. Then, we study the SNL for the case with errors affecting the anchor node position and the inter-node distance measurements. Specifically, we establish that in case these errors are sufficiently small, the NE exists and is unique. It is shown that the NE is an approximate solution to the SNL problem, and that the position errors can be quantified accordingly. Based on these findings, we apply the results to case studies involving only inter-node distance measurement errors and only anchor position information inaccuracies. © 2024 IEEE.

关键词： Nash equilibrium

来源：评论

学校读者我要写书评

暂无评论

A Code-Driven Tutorial on Encrypted control: From Pioneering Realizations to Modern Implementations

A Code-Driven Tutorial on Encrypted Control: From Pioneering...

引用

European control Conference (ECC)

作者： Nils Schlüter Junsoo Kim Moritz Schulze Darup Dept. of Mechanical Engineering Control and Cyberphysical Systems Group TU Dortmund University Germany Department of Electrical and Information Engineering Seoul National University of Science and Technology South Korea

ISBN: (数字)9783907144107

ISBN: (纸本)9798331540920

The growing interconnectivity in control systems due to robust wireless communication and cloud usage paves the way for exciting new opportunities such as data-driven control and service-based decision-making. At the same time, connected systems are susceptible to cyberattacks and data leakages. Against this background, encrypted control aims to increase the security and safety of cyber- physical systems. A central goal is to ensure confidentiality of process data during networked controller evaluations, which is enabled by, e.g., homomorphic encryption. However, the integration of advanced cryptographic systems renders the design of encrypted controllers an inter-disciplinary challenge. This code-driven tutorial paper aims to facilitate the access to encrypted control by providing exemplary realizations based on popular homomorphic cryptosystems. In particular, we discuss the encrypted implementation of state feedback and PI controllers using the Paillier, GSW, and CKKS cryptosystem.

关键词： Wireless communication State feedback PI control Process control Europe Tutorials Elliptic curve cryptography

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：