检索结果-内蒙古大学图书馆

Risk-Sensitive Inhibitory control for Safe Reinforcement Learning

学校读者我要写书评

暂无评论

Risk-Sensitive Inhibitory Control for Safe Reinforcement Lea...

IEEE Conference on Decision and control

作者： Armin Lederer Erfaun Noorani John S. Baras Sandra Hirche Chair of Information-oriented Control (ITR) School of Computation Information and Technology Technical University of Munich Munich Germany Department of Electrical and Computer Engineering Institute for Systems Research (ISR) at the University of Maryland College Park MD USA

Humans have the ability to deviate from their natural behavior when necessary, which is a cognitive process called response inhibition. Similar approaches have independently received increasing attention in recent years for ensuring the safety of control. Realized using control barrier functions or predictive safety filters, these approaches can effectively ensure the satisfaction of state constraints through an online adaptation of nominal control laws, e.g., obtained through reinforcement learning. While the focus of these realizations of inhibitory control has been on risk-neutral formulations, human studies have shown a tight link between response inhibition and risk attitude. Inspired by this insight, we propose a flexible, risk-sensitive method for inhibitory control. Our method is based on a risk-aware condition for value functions, which guarantees the satisfaction of state constraints. We propose a method for learning these value functions using common techniques from reinforcement learning and derive sufficient conditions for its success. By enforcing the derived safety conditions online using the learned value function, risk-sensitive inhibitory control is effectively achieved. The effectiveness of the developed control scheme is demonstrated in simulations.

关键词：

PredRecon: A Prediction-boosted Planning Framework for Fast and High-quality Autonomous Aerial Reconstruction

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Feng, Chen Li, Haojia Gao, Fei Zhou, Boyu Shen, Shaojie School of Artificial Intelligence Sun Yat-Sen University Zhuhai China Department of Electronic and Computer Engineering The Hong Kong University of Science and Technology Hong Kong State Key Laboratory of Industrail Control Technology Institute of Cyber-Systems and Control Zhejiang University Hangzhou China Huzhou Institute Zhejiang University Huzhou China

Autonomous UAV path planning for 3D reconstruction has been actively studied in various applications for high-quality 3D models. However, most existing works have adopted explore-then-exploit, prior-based or exploration-based strategies, demonstrating inefficiency with repeated flight and low autonomy. In this paper, we propose PredRecon, a prediction-boosted planning framework that can autonomously generate paths for high 3D reconstruction quality. We obtain inspiration from humans can roughly infer the complete construction structure from partial observation. Hence, we devise a surface prediction module (SPM) to predict the coarse complete surfaces of the target from the current partial reconstruction. Then, the uncovered surfaces are produced by online volumetric mapping waiting for observation by UAV. Lastly, a hierarchical planner plans motions for 3D reconstruction, which sequentially finds efficient global coverage paths, plans local paths for maximizing the performance of Multi-View Stereo (MVS), and generates smooth trajectories for image-pose pairs acquisition. We conduct benchmarks in the realistic simulator, which validates the performance of PredRecon compared with the classical and state-of-the-art methods. The open-source code is released at https://***/HKUST-Aerial-Robotics/PredRecon. Copyright © 2023, The Authors. All rights reserved.

关键词： Forecasting

Probabilistic Tube-based control Synthesis of Stochastic Multi-Agent systems under Signal Temporal Logic

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Vlahakis, Eleftherios E. Lindemann, Lars Sopasakis, Pantelis Dimarogonas, Dimos V. Division of Decision and Control Systems School of Electrical Engineering and Computer Science KTH Royal Institute of Technology Stockholm10044 Sweden Thomas Lord Department of Computer Science Viterbi School of Engineering University of Southern California Los AngelesCA90089 United States School of Electronics Electrical Engineering and Computer Science Queen’s University Northern Ireland Belfast United Kingdom

We consider the control design of stochastic discrete-time linear multi-agent systems (MASs) under a global signal temporal logic (STL) specification to be satisfied at a predefined probability. By decomposing the dynamics into deterministic and error components, we construct a probabilistic reachable tube (PRT) as the Cartesian product of reachable sets of the individual error systems driven by disturbances lying in confidence regions (CRs) with a fixed probability. By bounding the PRT probability with the specification probability, we tighten all state constraints induced by the STL specification by solving tractable optimization problems over segments of the PRT, and relax the underlying stochastic problem with a deterministic one. This approach reduces conservatism compared to tightening guided by the STL structure. Additionally, we propose a recursively feasible algorithm to attack the resulting problem by decomposing it into agent-level subproblems, which are solved iteratively according to a scheduling policy. We demonstrate our method on a ten-agent system, where existing approaches are impractical. © 2024, CC BY.

关键词： Stochastic systems

Enhancing Precision Agriculture Through Human-in-the-Loop Planning and control

学校读者我要写书评

暂无评论

Enhancing Precision Agriculture Through Human-in-the-Loop Pl...

IEEE International Conference on Automation Science and Engineering (CASE)

作者： Shankar A. Deka Sujet Phodapol Andreu Matoses Gimenez Victor Nan Fernandez-Ayala Rufus Wong Pian Yu Xiao Tan Dimos V. Dimarogonas Department of Electrical Engineering and Automation School of Electrical Engineering Aalto University Espoo Finland Division of Decision and Control Systems School of EECS Royal Institute of Technology (KTH) Stockholm Sweden Department of Cognitive Robotics Faculty of Mechanical Engineering TU Delft Delft Netherlands Department of Computer Science University of Oxford Oxford UK

ISBN: (数字)9798350358513

ISBN: (纸本)9798350358520

In this paper, we introduce a ROS based framework designed for the planning and control of robotic systems within the context of precision agriculture, with an emphasis on human-in-the-loop capabilities. Utilizing Linear Temporal Logic to articulate complex task specifications, our algorithm creates high-level robotic plans that are not only correct by design but also adaptable in real time by human operators. This dual-focus approach ensures that while humans have the flexibility to modify the high-level plan on-the-fly or even take over low-level control of the robots, the system inherently safeguards against any human actions that could potentially breach the predefined task specifications. We demonstrate our algorithm within the dynamic and challenging environment of a real vineyard, where the collaboration between human workers and robots is critical for tasks such as harvesting and pruning, and show the practical applicability and robustness of our software. This work marks a pioneering application of formal methods to complex, real-world agricultural environments.

关键词： Precision agriculture Heuristic algorithms Software algorithms Robustness Human in the loop Software Real-time systems Planning Robots Multi-agent systems

Convergence Analysis of the Best Response Algorithm for Time-Varying Games

学校读者我要写书评

暂无评论

Convergence Analysis of the Best Response Algorithm for Time...

IEEE Conference on Decision and control

作者： Zifan Wang Yi Shen Michael M. Zavlanos Karl H. Johansson Division of Decision and Control Systems School of Electrical Enginnering and Computer Science KTH Royal Institute of Technology and also with Digital Futures Stockholm Sweden Department of Mechanical Engineering and Materials Science Duke University Durham NC USA

This paper studies a class of strongly monotone games involving non-cooperative agents that optimize their own time-varying cost functions. We assume that the agents can observe other agents' historical actions and choose actions that best respond to other agents' previous actions; we call this a best response scheme. We start by analyzing the convergence rate of this best response scheme for standard time-invariant games. Specifically, we provide a sufficient condition on the strong monotonicity parameter of the time-invariant games under which the proposed best response algorithm achieves exponential convergence to the static Nash equilibrium. We further illustrate that this best response algorithm may oscillate when the proposed sufficient condition fails to hold, which indicates that this condition is tight. Next, we analyze this best response algorithm for time-varying games where the cost functions of each agent change over time. Under similar conditions as for time-invariant games, we show that the proposed best response algorithm stays asymptotically close to the evolving equilibrium. We do so by analyzing both the equilibrium tracking error and the dynamic regret. Numerical experiments on economic market problems are presented to validate our analysis.

关键词：

AutoTrans: A Complete Planning and control Framework for Autonomous UAV Payload Transportation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Li, Haojia Wang, Haokun Feng, Chen Gao, Fei Zhou, Boyu Shen, Shaojie School of Artificial Intelligence Sun Yat-Sen University Zhuhai China Department of Electronic and Computer Engineering Hong Kong University of Science and Technology Hong Kong State Key Laboratory of Industrial Control Technology Institute of Cyber-Systems and Control Zhejiang University Hangzhou China Huzhou Institute Zhejiang University Huzhou China

The robotics community is increasingly interested in autonomous aerial transportation. Unmanned aerial vehicles with suspended payloads have advantages over other systems, including mechanical simplicity and agility, but pose great challenges in planning and control. To realize fully autonomous aerial transportation, this paper presents a systematic solution to address these difficulties. First, we present a real-time planning method that generates smooth trajectories considering the time-varying shape and non-linear dynamics of the system, ensuring whole-body safety and dynamic feasibility. Additionally, an adaptive NMPC with a hierarchical disturbance compensation strategy is designed to overcome unknown external perturbations and inaccurate model parameters. Extensive experiments show that our method is capable of generating high-quality trajectories online, even in highly constrained environments, and tracking aggressive flight trajectories accurately, even under significant uncertainty. We plan to release our code to benefit the community. © 2023, CC BY-NC-ND.

关键词： Trajectories

Rao-Blackwellized Particle Smoothing for Simultaneous Localization and Mapping

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Kok, Manon Solin, Arno Schön, Thomas B. Delft Center for Systems and Control Delft University of Technology Mekelweg 2 Delft2628 CD Netherlands Department of Computer Science Aalto University Konemiehentie 2 AaltoFI-00076 Finland Department of Information Technology Uppsala University Box 337 UppsalaSE-751 05 Sweden

Simultaneous localization and mapping (SLAM) is the task of building a map representation of an unknown environment while at the same time using it for positioning. A probabilistic interpretation of the SLAM task allows for incorporating prior knowledge and for operation under uncertainty. Contrary to the common practice of computing point estimates of the system states, we capture the full posterior density through approximate Bayesian inference. This dynamic learning task falls under state estimation, where the state-of-the-art is in sequential Monte Carlo methods that tackle the forward filtering problem. In this paper, we introduce a framework for probabilistic SLAM using particle smoothing that does not only incorporate observed data in current state estimates, but it also back-tracks the updated knowledge to correct for past drift and ambiguities in both the map and in the states. Our solution can efficiently handle both dense and sparse map representations by Rao-Blackwellization of conditionally linear and conditionally linearized models. We show through simulations and real-world experiments how the principles apply to radio (BLE/Wi-Fi), magnetic field, and visual SLAM. The proposed solution is general, efficient, and works well under confounding noise. Copyright © 2023, The Authors. All rights reserved.

关键词： Magnetic fields

State Estimation for Integrated Energy systems: Motivations, Advances, and Future Work

学校读者我要写书评

暂无评论

IEEE Transactions on Power systems 2024年第4期40卷 3057-3073页

作者： Zhao, Junbo Srivastava, Ankur Guo, Ye Cetenovic, Dragan Lin, Yuzhang Levi, Victor Yin, Guanxiong Huang, Manyun Zhang, Tingting Li, Zhigang Chen, Yanbo Exposito, Antonio G. Zhang, Wen Zheng, Weiye Chakrabarti, Saikat Li, Yang Sharma, Ankush Kamwa, Innocent Guo, Qinglai Terzija, Vladimir Mili, Lamine University of Connecticut Department of Electrical and Computer Engineering StorrsCT06269 United States Tsinghua University Tsinghua-Berkeley Shenzhen Institute Shenzhen518055 China The University of Manchester Department of Eee ManchesterM13 9PL United Kingdom University of Kragujevac Faculty of Technical Sciences Čačak Čačak32000 Serbia New York University Department of Electrical and Computer Engineering NY11201 United States Tsinghua University Department of Electrical Engineering Beijing100084 China Hohai University College of Energy and Electrical Engineering Nanjing210098 China Shandong University Key Laboratory of Power System Intelligent Dispatch and Control Ministry of Education Jinan250061 China The Chinese University of Hong Kong-Shenzhen School of Science and Engineering Shenzhen518172 China North China Electric Power University School of Electrical and Electronic Engineering Beijing102206 China University of Sevilla Spain Sevilla41092 Spain South China University of Technology School of Electrical Power Engineering Guangzhou510641 China Indian Institute of Technology Kanpur Department of Electrical Engineering Kanpur208016 India Northeast Electric Power University School of Electrical Engineering Jilin132012 China Laval University Department of Electrical and Computer Engineering QuebecQCG1V 0A6 Canada Tsinghua University State Key Laboratory of Power Systems Department of Electrical Engineering Beijing100084 China Newcastle University School of Engineering Newcastle upon TyneNE1 7RU United Kingdom Virginia Polytechnic Institute and State University Bradley Department of Electrical and Computer Engineering Falls ChurchVA22043 United States

This paper summarizes the technical activities of a three-year-long IEEE Task Force (TF) on State Estimation (SE) for Integrated Energy systems (IES). It presents the formal definition and characteristics of IES, along with the comprehensive discussion on Electric Power systems (EPS) model, and static and dynamic models associated with heating and natural gas systems. The paper also identifies the barriers of SE for IES, such as estimation modeling, observability analysis, and measurement requirements, together with addressing multi-scale dynamics. An extensive comparative analysis between Integrated Energy systems-State Estimation (IES-SE) and more established Electric Power System-State Estimation (EPS-SE) is presented. The paper also provides future research needs and directions related to IES-SE. © 1969-2012 IEEE.

关键词： Power system analysis

PredRecon: A Prediction-boosted Planning Framework for Fast and High-quality Autonomous Aerial Reconstruction

学校读者我要写书评

暂无评论

PredRecon: A Prediction-boosted Planning Framework for Fast ...

IEEE International Conference on Robotics and Automation (ICRA)

作者： Chen Feng Haojia Li Fei Gao Boyu Zhou Shaojie Shen Department of Electronic and Computer Engineering The Hong Kong University of Science and Technology Hong Kong China State Key Laboratory of Industrail Control Technology Institute of Cyber-Systems and Control Zhejiang University Hangzhou China Huzhou Institute Zhejiang University Huzhou China School of Artificial Intelligence Sun Yat-Sen University Zhuhai China

关键词：