检索结果-内蒙古大学图书馆

Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced control Applications

IEEE/CAA Journal of Automatica Sinica 2024年第1期11卷 18-36页

作者： Ding Wang Ning Gao Derong Liu Jinna Li Frank L.Lewis IEEE the Faculty of Information Technology Beijing Key Laboratory of Computational Intelligence and Intelligent SystemBeijing Laboratory of Smart Environmental Protectionand Beijing Institute of Artificial IntelligenceBeijing University of TechnologyBeijing 100124China the School of System Design and Intelligent Manufacturing Southern University of Science and TechnologyShenzhen 518055China the Department of Electrical and Computer Engineering University of Illinois at ChicagoChicago IL 60607 USA the School of Information and Control Engineering Liaoning Petrochemical UniversityFushun 113001China the UTA Research Institute the University of Texas at ArlingtonArlington TX 76118 USA

Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, ***, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation ***, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.

关键词： Adaptive dynamic programming(ADP) advanced control complex environment data-driven control event-triggered design intelligent control neural networks nonlinear systems optimal control reinforcement learning(RL)

来源：评论

学校读者我要写书评

暂无评论

Risk-Aware Wasserstein Distributionally Robust control of Vessels in Natural Waterways

arXiv

引用

arXiv 2023年

作者： Nadales, Juan Moreno Hakobyan, Astghik de la Peña, David Muñoz Limon, Daniel Yang, Insoon The Department of Automatic Control and System Engineering University of Seville Spain The Department of Electrical and Computer Engineering Seoul National University Korea Republic of

In the realm of maritime transportation, autonomous vessel navigation in natural inland waterways faces persistent challenges due to unpredictable natural factors. Existing scheduling algorithms fall short in handling these uncertainties, compromising both safety and efficiency. Moreover, these algorithms are primarily designed for non-autonomous vessels, leading to labor-intensive operations vulnerable to human error. To address these issues, this study proposes a risk-aware motion control approach for vessels that accounts for the dynamic and uncertain nature of tide islands in a distributionally robust manner. Specifically, a model predictive control method is employed to follow the reference trajectory in the time-space map while incorporating a risk constraint to prevent grounding accidents. To address uncertainties in tide islands, a novel modeling technique represents them as stochastic polytopes. Additionally, potential inaccuracies in waterway depth are addressed through a risk constraint that considers the worst-case uncertainty distribution within a Wasserstein ambiguity set around the empirical distribution. Using sensor data collected in the Guadalquivir River, we empirically demonstrate the performance of the proposed method through simulations on a vessel. As a result, the vessel successfully navigates the waterway while avoiding grounding accidents, even with a limited dataset of observations. This stands in contrast to existing non-robust controllers, highlighting the robustness and practical applicability of the proposed approach. Copyright © 2023, The Authors. All rights reserved.

关键词： Stochastic systems

来源：评论

学校读者我要写书评

暂无评论

Complexity results and active-set identification of a derivative-free method for bound-constrained problems

arXiv

引用

arXiv 2024年

作者： Brilli, Andrea Cristofari, Andrea Liuzzi, Giampaolo Lucidi, Stefano Department of Computer Control and Management Engineering Sapienza University of Rome Via Ariosto 25 Rome00185 Italy Department of Civil Engineering and Computer Science Engineering University of Rome "Tor Vergata" Via del Politecnico 1 Rome00133 Italy

In this paper, we analyze a derivative-free line search method designed for bound-constrained problems. Our analysis demonstrates that this method exhibits a worst-case complexity comparable to other derivative-free methods for unconstrained and linearly constrained problems. In particular, when minimizing a function with n variables, we prove that at most O (nϵ−2) iterations are needed to drive a criticality measure below a predefined threshold ǫ, requiring at most O (n2ϵ−2) function evaluations. We also show that the total number of iterations where the criticality measure is not below ǫ is upper bounded by O (n2ϵ−2). Moreover, we investigate the method capability to identify active constraints at the final solutions. We show that, after a finite number of iterations, all the active constraints satisfying the strict complementarity condition are correctly identified. Copyright © 2024, The Authors. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Stability Enhancement of LCL-Type Grid-Following Inverters Using Capacitor Voltage Active Damping

Stability Enhancement of LCL-Type Grid-Following Inverters U...

引用

IEEE General Meeting Power& Energy Society

作者： Naser Souri Ali Mehrizi-Sani Kambiz Tehrani The Bradley Department of Electrical and Computer Engineering Virginia Tech Blacksburg VA Department of Energy and Control University of Normandy-ESIGELEC-IRSEEM Rouen France

ISBN: (数字)9798350381832

ISBN: (纸本)9798350381849

An LCL filter offers superior attenuation for high-frequency harmonics for three-phase grid-following inverters compared to LC and L filters. However, it also introduces an inherent resonance peak, which can lead to power quality issues or even instability of the inverter control system. Active damping (AD) is widely employed to effectively mitigate this resonance. Capacitor voltage feedback (CVF) and capacitor current feedback (CCF) are effective AD methods for LCL resonance damping. CVF is preferred due to its lower sensor requirement compared to CCF. However, a derivative term appears in the active damping loop, which introduces high-frequency noise into the system. This paper proposes a noise-immune approach by replacing the derivative term with a discrete function suitable for digital implementation. The LCL resonance can be damped effectively, resulting in enhanced stability of the inverter control system. Simulation results verify the proposed effectiveness of the method with grid inductance variation and weak grid conditions.

关键词： Damping Simulation Grid following Capacitors Power quality Noise Power system stability Resonance Stability analysis Power harmonic filters

来源：评论

学校读者我要写书评

暂无评论

A Load Balancing Algorithm For Long-Life Green Edge Systems

A Load Balancing Algorithm For Long-Life Green Edge Systems

引用

IEEE International Conference on Cloud Computing Technology and Science (CloudCom)

作者： Roberto Beraldi Gabriele Proietti Mattia Department of Computer Control and Management Engineering "Antonio Ruberti" Sapienza University of Rome Rome Italy

We consider the case of a set of energy harvesting edge nodes, equipped with photovoltaic panels that implement some kind of monitoring service. To ensure that the service operates in an optimal way, nodes have sometimes offload some of their data to other nodes. We show that this kind of task offloading (migration) can improve service performance by avoiding temporary interruptions and prolonging the overall service lifetime. We present a centralized algorithm based on Linear Programming optimization problem solution and a distributed implementation.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Adversarial Training with Maximal Coding Rate Reduction

Adversarial Training with Maximal Coding Rate Reduction

引用

Asilomar Conference on Signals, Systems & computers

作者： Hsiang-Yu Chu Hongbo Zhao Markus Flierl Electrical Engineering and Computer Science KTH Royal Institute of Technology Stockholm Sweden Department of Control Science and Engineering Harbin Institute of Technology Harbin China

ISBN: (数字)9798350354058

ISBN: (纸本)9798350354065

Deep convolutional networks can solve various complex tasks in the field of image processing. However, adversarial attacks have been shown to have the ability of fooling deep learning models. Adversarial training is one commonly used strategy to improve the robustness of deep learning models against adversarial examples, which is performed by incorporating adversarial examples into the training process. Traditionally, during this process, cross-entropy loss is used as the loss function. In order to improve the robustness of deep learning models against adversarial examples, we propose in this paper two new methods of adversarial training by applying the principle of Maximal Coding Rate Reduction (MCR 2 ). We evaluate the performance of different adversarial training methods by comparing the clean accuracy and adversarial accuracy. It is shown that adversarial training with the MCR 2 loss function yields a more robust network than the traditional adversarial training method. In our experiments, adversarial accuracies are improved by up to 10%. The two loss functions are discussed by using a model.

关键词： Training Deep learning Hands Accuracy Image coding Computational modeling Robustness Data models Encoding Convolutional neural networks

来源：评论

学校读者我要写书评

暂无评论

Random Forest Regression for Battery State-of-Health Estimation Based on Unsupervised Transfer Component Analysis Domain Adaptation

Random Forest Regression for Battery State-of-Health Estimat...

引用

2022 IEEE International Conference on Industrial Technology, ICIT 2022

作者： Tian, Jilun Zhang, Jiusi Huangy, Congsheng Chowz, Mo-Yuen Luo, Hao Harbin Institute of Technology Department of Control Science and Engineering Harbin150001 China National Taipei University of Technology Department of Electrical Engineering Taipei10608 Taiwan North Carolina State University Department of Electrical and Computer Engineering RaleighNC27606 United States

ISBN: (纸本)9781728119489

Machine learning is an useful approach estimating the state-of-health (SOH) of the lithium-ion batteries and had been successfully implemented on battery management systems (BMS). However, the SOH estimation accuracy of the machine learning relies highly on the similarity of training dataset and battery data of estimation. In other words, the machine learning approach may fail if the battery of estimation is operated in a different condition from the condition set for collecting the training dataset. This paper aims on solving such a problem by proposing a transfer component analysis-random forest regression (TCA-RF) approach. The robustness of this proposed approach is ensured by the random forest regression, which is an ensemble learning approach. The generalization of this proposed approach is enhanced by transfer component analysis since it achieves the domain adaption with well transformation of features between two datasets. Two battery ageing datasets collected in different operating conditions are selected in this paper to validate the success of the proposed work, where these two datasets are collected by the Center for Advanced Life Cycle engineering (CALCE) and the National Aeronautics and Space Administration (NASA) Prognostics Center of Excellence (PCoE). The proposed work is further compared with multiple commonly adopted intelligent algorithms to showcase the high performance of the proposed work. The experimental results shows that the proposed TCA-RF approach has a better accurate SOH estimation comparing to other estimation algorithms by 2% to more 50%. © 2022 IEEE.

关键词： Lithium-ion batteries

来源：评论

学校读者我要写书评

暂无评论

Sailing Through Point Clouds: Safe Navigation Using Point Cloud Based control Barrier Functions

arXiv

引用

arXiv 2024年

作者： Dai, Bolun Khorrambakht, Rooholla Krishnamurthy, Prashanth Khorrami, Farshad Control/Robotics Research Laboratory Electrical & Computer Engineering Department Tandon School of Engineering New York University BrooklynNY11201 United States

The capability to navigate safely in an unstructured environment is crucial when deploying robotic systems in real-world scenarios. Recently, control barrier function (CBF) based approaches have been highly effective in synthesizing safety-critical controllers. In this work, we propose a novel CBF-based local planner comprised of two components: Vessel and Mariner. The Vessel is a novel scaling factor based CBF formulation that synthesizes CBFs using only point cloud data. The Mariner is a CBF-based preview control framework that is used to mitigate getting stuck in spurious equilibria during navigation. To demonstrate the efficacy of our proposed approach, we first compare the proposed point cloud based CBF formulation with other point cloud based CBF formulations. Then, we demonstrate the performance of our proposed approach and its integration with global planners using experimental studies on the Unitree B1 and Unitree Go2 quadruped robots in various environments. © 2024, CC BY.

关键词： Robot programming

来源：评论

学校读者我要写书评

暂无评论

Enhanced Nature Inspired-Support Vector Machine for Glaucoma Detection

引用

computers, Materials & Continua 2023年第7期76卷 1151-1172页

作者： Jahanzaib Latif Shanshan Tu Chuangbai Xiao Anas Bilal Sadaqat Ur Rehman Zohaib Ahmad Engineering Research Center of Intelligent Perception and Autonomous Control Faculty of Information TechnologyBeijing University of Technology100124BeijingChina College of Information Science Technology Hainan Normal UniversityHainan ProvinceHaikou571158China Department of Computer Science University of SalfordManchesterUK Faculty of Information Technology Beijing University of Technology Chaoyang District BeijingChina

Glaucoma is a progressive eye disease that can lead to blindness if left *** detection is crucial to prevent vision loss,but current manual scanning methods are expensive,time-consuming,and require specialized *** study presents a novel approach to Glaucoma detection using the Enhanced Grey Wolf Optimized Support Vector Machine(EGWO-SVM)*** proposed method involves preprocessing steps such as removing image noise using the adaptive median filter(AMF)and feature extraction using the previously processed speeded-up robust feature(SURF),histogram of oriented gradients(HOG),and Global *** enhanced Grey Wolf Optimization(GWO)technique is then employed with SVM for *** evaluate the proposed method,we used the online retinal images for glaucoma analysis(ORIGA)database,and it achieved high accuracy,sensitivity,and specificity rates of 94%,92%,and 92%,*** results demonstrate that the proposed method outperforms other current algorithms in detecting the presence or absence of *** study provides a novel and effective approach to Glaucoma detection that can potentially improve the detection process and outcomes.

关键词： Glaucoma detection grey golf optimization support vector machine feature extraction image classification

来源：评论

学校读者我要写书评

暂无评论

Multi-Timescale Trading Strategy for Renewable Power to Ammonia Virtual Power Plant in the Electricity, Hydrogen, and Ammonia Markets

IEEE Transactions on Energy Markets, Policy and Regulation

引用

IEEE Transactions on Energy Markets, Policy and Regulation 2023年第4期1卷 322-335页

作者： Wu, Sirui Lin, Jin Li, Jiarong Liu, Feng Song, Yonghua Xu, Yanhui Cheng, Xiang Yu, Zhipeng Tsinghua University State Key Laboratory of Control and Simulation of Power Systems and Generation Equipment Department of Electrical Engineering Beijing100087 China Tsinghua University Sichuan Energy Internet Research Institute Chengdu610213 China University of Macau Department of Electrical and Computer Engineering Macau999078 China Tsinghua University Department of Electrical Engineering Beijing100087 China State Key Laboratory of Alternate Electrical Power System with Renewable Energy Sources North China Electric Power University Beijing102206 China

Renewablepower to ammonia (RePtA) is a prominent zero-carbon pathway for decarbonization. Due to the imbalance between renewables and production energy demand, the RePtA system relies on electricity exchange with the power grid. Participating in the electricity market as a virtual power plant (VPP) may help to reduce energy costs. However, the power profile of local photovoltaics and wind turbines is similar to those in the market, resulting in rising energy costs under the conventional strategy. Hence, we develop a multi-timescale trading strategy for the RePtA VPP in the electricity, hydrogen, and ammonia markets. By utilizing the hydrogen and ammonia buffer systems, the RePtA VPP can optimally coordinate production planning. Moreover, we find it possible to describe the trading of electricity, ammonia, and hydrogen in a unified timeframe. The two-stage robust optimization model of the electricity market is extended to multiple markets and solved by the column and constraint generation (CC&G) algorithm. The case is derived from an actual project in the Inner Mongolia Autonomous Region. Sensitivity analysis demonstrates the economic advantages of the RePtA VPP joining multiple markets over the conventional strategy and reveals the necessity of the hydrogen and ammonia buffer and reactor flexibility. © 2023 IEEE.

关键词： Ammonia

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：