检索结果-内蒙古大学图书馆

Mean policy-based proximal policy optimization for maneuvering decision in multi-UAV air combat

Neural Computing and Applications 2024年第31期36卷 19667-19690页

作者： Zheng, Yifan Xin, Bin He, Bin Ding, Yulong Department of Control Science and Engineering Tongji University Shanghai China Frontiers Science Center for Intelligent Autonomous Systems Ministry of Education Shanghai China School of Automation Beijing Institute of Technology Beijing China National Key Lab of Autonomous Intelligent Unmanned Systems Beijing China Beijing Advanced Innovation Center for Intelligent Robots and Systems Beijing Institute of Technology Beijing China

Autonomous maneuvering decision-making is a crucial technology for Unmanned Aerial Vehicles (UAVs) to take the air domination in modern unmanned warfare. With the advantage of balancing exploration and exploitation, as well as the immediacy of end-to-end output by combining with deep neural network, multi-agent reinforcement learning (MARL) has made remarkable achievements in multi-UAV autonomous air combat maneuvering decision-making (MUAAMD). However, the implementation of effective cooperative policy learning remains a challenging issue for MARL methods with centralized training decentralized execution (CTDE) paradigm. This paper proposes a MARL-based method to improve the performance of cooperation in MUAAMD. Firstly, considering the constraints of dynamic and limited perception for UAVs in the realistic air combat scenario, the MUAAMD problem is formulated based on partially observable Markov game (POMG) model. Secondly, a novel efficient MARL algorithm named the mean policy-based proximal policy optimization (MP3O) is introduced. Specifically, a joint policy optimization mechanism is constructed by estimating the policies of neighboring agents in group as a mean-field approximation while training, which enables both centralized evaluation and improvement of cooperative policy under the CTDE paradigm. Thirdly, by combining with three improvement techniques, a cooperative decision-making framework for MUAAMD based on MP3O is proposed. Empirically, results of simulations and comparative experiments validate the effectiveness of proposed method in promoting cooperative policy learning in resolving MUAAMD problem. © The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2024.

关键词： Decision making

来源：评论

学校读者我要写书评

暂无评论

Relationship Between Mechanical Deformation and Contact Force Applied by Catheter Tip on Cardiac Muscle: Experimentation and Computer Modeling 5

Relationship Between Mechanical Deformation and Contact Forc...

引用

5th IEEE Eurasia Conference on Biomedical engineering, Healthcare and Sustainability, ECBIOS 2023

作者： Ijima, Yukako Masnok, Kriengsak Perez, Juan J. Gonzalez-Suarez, Ana Berjano, Enrique Watanabe, Nobuo Master's Program Global Course of Engineering and Science Graduate School of Engineering and Science Shibaura Institute of Technology Saitama Japan Functional Control Systems Graduate School of Engineering and Science Shibaura Institute of Technology Biofluid Science and Engineering Laboratory Saitama Japan Universitat Politecnica de Valencia BioMIT Department of Electronic Engineering Valencia Spain School of Engineering University of Galway Translational Medical Device Lab Galway Ireland Functional Control Systems Graduate School of Engineering and Science College of Systems Engineering and Science Shibaura Institute of Technology Biofluid Science and Engineering Laboratory Department of Bio-Science and Engineering Saitama Japan

ISBN: (纸本)9798350320978

The cardiac muscle is elastic and deformable. Pushing a catheter in contact with the cardiac muscle surface to conduct focal energy-based ablative therapies, such as RF ablation, requires an adequate electrode-tissue contact surface to transfer the energy to the target site. In this regard, the relationship between the contact force (CF) and the resulting mechanical response is still unclear, in particular, the insertion depth (ID) and the diameter of the surface deformation. The objective of this study was to quantify these relationships using an ex vivo model and a computational model. A rigid bar with a 2.3 mm diameter blunt tip (mimicking a 7Fr standard ablation catheter) was placed at a perpendicular orientation on a fragment of the porcine heart. CF values ranged from 10 to 80g. We used ANSYS to build a Mooney-Rivlig model of 3 parameters based on hyperelastic material and to simulate the same conditions as in the experiments. The experimental results showed a strong linear correlation between CF and insertion depth ID ($\mathrm{R}^{2}=0.97, \mathrm{P} © 2023 IEEE.

关键词： Catheters

来源：评论

学校读者我要写书评

暂无评论

Deep Learning-based Source Code Classification and Visualization of Decision Rationales 28th

Deep Learning-based Source Code Classification and Visualiza...

引用

28th International Conference on Knowledge Based and Intelligent information and engineering systems, KES 2024

作者： Oeda, Shinichi Mitsumori, Seiya Department of Information and Computer Engineering National Institute of Technology Kisarazu College 11-1 Kiyomidaihigashi 2-chome Kisarazu City Chiba Japan Advanced Course of Control and Information Engineering National Institute of Technology Kisarazu College 11-1 Kiyomidaihigashi 2-chome Kisarazu City Chiba Japan

In programming education, it is crucial to provide instruction that is tailored to students' proficiency levels. For this purpose, an objective evaluation of each student's coding ability is essential. Additionally, it is necessary to understand the characteristics of source code written by both beginners and advanced students. Previous research has successfully converted the structural information of source code into graphs and assessed coding skills using deep learning, achieving high accuracy. However, it remains unclear which specific structural elements significantly influence these assessments. This study addresses this gap by transforming source code into abstract syntax trees and developing a model that uses Graph Convolutional Networks to categorize code as either beginner or advanced users based on learned structural information. Furthermore, we apply Integrated Gradients to visualize the decision-making basis of our model and elucidate the structural characteristics distinguishing source code written by beginner and advanced users. © 2024 The Authors.

关键词： Adversarial machine learning

来源：评论

学校读者我要写书评

暂无评论

The Journey/DAO/TAO of Embodied Intelligence: From Large Models to Foundation Intelligence and Parallel Intelligence

引用

IEEE/CAA Journal of Automatica Sinica 2024年第6期11卷 1313-1316页

作者： Tianyu Shen Jinlin Sun Shihan Kong Yutong Wang Juanjuan Li Xuan Li Fei-Yue Wang College of Information Science and Technology Beijing University of Chemical TechnologyBeijing 100029China School of Electrical and Information Engineering Jiangsu UniversityZhenjiang 212013China State Key Laboratory for Turbulence and Complex Systems Department of Advanced Manufacturing and RoboticsCollege of EngineeringPeking UniversityBeijing 100871China State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of AutomationChinese Academy of SciencesBeijing 100190China Peng Cheng Laboratory Shenzhen 518000China State Key Laboratory for Management and Control of Complex Systems Chinese Academy of SciencesBeijing 100190 Faculty of Innovation Engineering Macao University of Science and TechnologyMacao 999078China IEEE

THE tremendous impact of large models represented by ChatGPT[1]-[3]makes it necessary to con-sider the practical applications of such models[4].However,for an artificial intelligence(AI)to truly evolve,it needs to possess a physical“body”to transition from the virtual world to the real world and evolve through interaction with the real *** this context,“embodied intelligence”has sparked a new wave of research and technology,leading AI beyond the digital realm into a new paradigm that can actively act and perceive in a physical environment through tangible entities such as robots and automated devices[5].

关键词： Intelligence DAO TAO

来源：评论

学校读者我要写书评

暂无评论

Model Predictive control of a wastewater treatment process using neural networks 28

Model Predictive Control of a wastewater treatment process u...

引用

28th IEEE International Conference on Emerging Technologies and Factory Automation, ETFA 2023

作者： Vasiliev, Iulian Luca, Irina Condrachi, Larisa Luca, Laurentiu Barbu, Marian Vilanova, Ramon Caraman, Sergiu Dunǎrea de Jos University of Galati Department of Automation and Electrical Engineering Galati Romania Autonomous University of Barcelona Department of Automation Systems and Advanced Control Research Barcelona Spain

ISBN: (纸本)9798350339918

This paper deals with the increasing of the operation efficiency of a wastewater treatment plant by reducing the level of pollutant concentration in the effluent. In essence, the main goal is the reduction of the concentration of organic substrate, Model Predictive control algorithm being used for this, considering as a model of the wastewater treatment process a neural network model based on a simplified mathematical model of the 4th order. For the implementation of the control algorithm, two neural networks were trained. In the first version of the neural network, it was considered that all 4 state variables are measurable and in the second version, only the organic substrate was considered measurable. Regarding the training of the two neural networks, good results were obtained in the case of both versions. Instead, the control algorithm gave better results when the second neural network was used (lower values of the substrate, lower variations of the aeration rate, which means a lower cost of operation). © 2023 IEEE.

关键词： Neural networks

来源：评论

学校读者我要写书评

暂无评论

An analysis towards integrated control of wastewater collecting and treatment systems 27

An analysis towards integrated control of wastewater collect...

引用

27th International Conference on System Theory, control and Computing, ICSTCC 2023

作者： Vasiliev, Iulian Luca, Laurentiu Barbu, Marian Vilanova, Ramon Caraman, Sergiu Department of Automation and Electrical Engineering Dunărea de Jos University of Galati Galati Romania Department of Automation Systems and Advanced Control Research Autonomous University of Barcelona Barcelona Spain

ISBN: (纸本)9798350337983

This paper deals with an analysis regarding the effect of Sewer Network operation on the performances of the integrated wastewater collecting and treatment system. The analysis is done by considering various control actions for the output storage tank of the sewer network, comparing a series of performance indicators defined for both subsystems with their "no control" value. Two cases have been considered regarding the control actions for the output storage tank of the sewer network: 1. keeping the output valve at a constant opening and 2. keeping the output valve at the maximum opening possible such as the outflow is limited to a constant value. While the second case did not prove advantageous, the first one showed that lowering the sewer network output valve opening would improve the integrated system performances. © 2023 IEEE.

关键词： Wastewater treatment

来源：评论

学校读者我要写书评

暂无评论

Tool Condition Monitoring Based on Nonlinear Output Frequency Response Functions and Multivariate control Chart

引用

Journal of Dynamics, Monitoring and Diagnostics 2023年第4期2卷 243-251页

作者： Yufei Gui Ziqiang Lang Zepeng Liu Hatim Laalej Department of Automatic Control and Systems Engineering University of SheffieldSheffield S102TNUK Advanced Manufacturing Research Centre University of SheffieldSheffield S102TNUK

Tool condition monitoring(TCM)is a key technology for intelligent *** objective is to monitor the tool operation status and detect tool breakage so that the tool can be changed in time to avoid significant damage to workpieces and reduce manufacturing ***,an innovative TCM approach based on sensor data modelling and model frequency analysis has been *** from traditional signal feature-based monitoring,the data from sensors are utilized to build a dynamic process ***,the nonlinear output frequency response functions,a concept which extends the linear system frequency response function to the nonlinear case,over the frequency range of the tooth passing frequency of the machining process are extracted to reveal tool health *** order to extend the novel sensor data modelling and model frequency analysis to unsupervised condition monitoring of cutting tools,in the present study,a multivariate control chart is proposed for TCM based on the frequency domain properties of machining processes derived from the innovative sensor data modelling and model frequency *** feature dimension is reduced by principal component analysis *** the moving average strategy is exploited to generate monitoring variables and overcome the effects of *** milling experiments of titanium alloys are conducted to verify the effectiveness of the proposed approach in detecting excessive flank wear of solid carbide end *** results demonstrate the advantages of the new approach over conventional TCM techniques and its potential in industrial applications.

关键词： intelligent manufacturing multivariate control chart Nonlinear Autoregressive with eXogenous Input modelling Nonlinear Output Frequency Response Functions tool condition monitoring

来源：评论

学校读者我要写书评

暂无评论

Trust Establishment for the Role-Based Collaborative Multi-Robot systems

Trust Establishment for the Role-Based Collaborative Multi-R...

引用

2023 IEEE International Conference on systems, Man, and Cybernetics, SMC 2023

作者： Akbari, Behzad Zhu, Haibin Pan, Ya-Jun Dalhousie University Advanced Control and Mechatronics Laboratory Department of Mechanical Engineering HalifaxNS Canada Nipissing University Collaborative Systems Laboratory Department of Computer Science and Mathematics North BayON Canada

ISBN: (纸本)9798350337020

Trust evaluation and trust establishment play crucial roles in the management of trust within a multi-agent system. When it comes to collaboration systems, trust becomes directly linked to the specific roles performed by agents. The Role-Based Collaboration (RBC) methodology serves as a framework for assigning roles that facilitate agent collaboration. Within this context, the behavior of an agent with respect to a role is referred to as a process role. This research paper introduces a role engine that incorporates a trust establishment algorithm aimed at identifying optimal and reliable process roles. In our study, we define trust as a continuous value ranging from 0 to 1. To optimize trustworthy process roles, we have developed a consensus-based Gaussian Process Factor Graph (GPFG) tool. Our simulations and experiments validate the feasibility and efficiency of our proposed approach with autonomous robots in unsignalized intersections and narrow hallways. © 2023 IEEE.

关键词： Gaussian process factor graph Multi-Agent systems (MASs) Role-based collaboration Trust management systems

来源：评论

学校读者我要写书评

暂无评论

MEASUREMENT OF VOID FRACTION DISTRIBUTION WITH SMALL WIRE MESH SENSOR INWATER-AIR TWO-PHASE BUBBLE AND SLUG FLOWS IN VERTICAL SMALL DIAMETER PIPE

引用

Multiphase Science and Technology 2021年第4期33卷 15-30页

作者： Tsubone, Hiroaki Shiotsuka, Tatsuya Yamashiro, Tomoharu Fujino, Tomohito Department of Creative Engineering National Institute of Technology Ariake College Japan Department of Mechanical and Aerospace Engineering Kyushu University Japan Advanced Production and Information Systems Engineering Course National Institute of Technology Ariake College Japan

Several refrigerants have been developed to solve environmental problems and to create efficient heat exchangers. The optimal design of the heat exchanger depends on the physical properties of the refrigerant. An electrical measurement for the flow characteristics is an effective experimental method. We developed a small wire mesh sensor to measure void fraction distribution parameters in refrigerant-air two-phase flow. Small wire mesh sensors without switching systems can be used for a refrigerant (e.g., HFE-71IPA), which can flow a small electric current under high voltage. For verification of the small wire mesh sensor, instantaneous and time averaged void fraction distribution in water-air two-phase flow in a vertical small diameter pipe was measured and analyzed for both bubble and slug flows. The test channel was a vertical circular 9 mm i.d. glass pipe. Each volumetric flux was 0.2-2.0 m/s for the gas phase and 0.1 m/s for the liquid phase in bubble flow, and 0.5- 1.0 for the gas phase and 0.2-0.3 m/s for the liquid phase in slug flow. The resulting void fraction distribution data were compared with different flow regimes, and past data and literature. The result showed that detail void fraction distribution measurement by using the small wire mesh sensor without switching system is possible for bubble and slug flow. © 2021 Begell House Inc.. All rights reserved.

关键词： Refrigerants

来源：评论

学校读者我要写书评

暂无评论

Improved material descriptors for bulk modulus in intermetallic compounds via machine learning

引用

Rare Metals 2023年第7期42卷 2396-2405页

作者： De-Xin Zhu Kun-Ming Pan Yuan Wu Xiao-Ye Zhou Xiang-Yue Li Yong-Peng Ren Sai-Ru Shi Hua Yu Shi-Zhong Wei Hong-Hui Wu Xu-Sheng Yang National Joint Engineering Research Center for Abrasion Control and Molding of Metal Materials Henan Key Laboratory of High-Temperature Structural and Functional MaterialsHenan University of Science and TechnologyLuoyang471003China Longmen Laboratory Luoyang471003China State Key Laboratory for Advanced Metals and Materials University of Science and Technology BeijingBeijing100083China Guangdong Province Key Laboratory of Durability for Marine Civil Engineering School of Civil EngineeringShenzhen UniversityShenzhen518060China Department of Industrial and Systems Engineering The Hong Kong Polytechnic UniversityHong Kong999077China

Bulk modulus is an important mechanical property in the optimal design and selection of intermetallic *** this study,bulk modulus datasets of intermetallic compounds were collected,and the features affecting the bulk modulus of intermetallics were screened via feature *** features B_(cal),dB_(avg),and TIE(corresponding to calculated bulk modulus,mean bulk modulus,and third ionization energy,respectively)were found to be the dominant factors influencing bulk modulus and can be extended to other multi-component ***,we predicted the bulk modulus with an accuracy of 95%using surrogate machine learning models with the selected features,and these features were also demonstrated to be effective for high-entropy ***,symbolic regression provided an expression for the relationship between bulk modulus and the screened *** machine learning models provide a new approach for optimizing and predicting the bulk moduli of intermetallic compounds.

关键词： Bulk modulus Intermetallic compounds Machine learning Symbolic regression

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：