检索结果-内蒙古大学图书馆

Policy iteration based Q-learning for linear nonzero-sum quadratic differential games

science China(Information sciences) 2019年第5期62卷 195-213页

作者： Xinxing LI Zhihong PENG Li LIANG Wenzhong ZHA School of Automation Beijing Institute of Technology State Key Laboratory of Intelligent Control and Decision of Complex System Information Science Academy China Electronics Technology Group Corporation

In this paper, a policy iteration-based Q-learning algorithm is proposed to solve infinite horizon linear nonzero-sum quadratic differential games with completely unknown dynamics. The Q-learning algorithm, which employs off-policy reinforcement learning(RL), can learn the Nash equilibrium and the corresponding value functions online, using the data sets generated by behavior policies. First, we prove equivalence between the proposed off-policy Q-learning algorithm and an offline PI algorithm by selecting specific initially admissible polices that can be learned online. Then, the convergence of the off-policy Qlearning algorithm is proved under a mild rank condition that can be easily met by injecting appropriate probing noises into behavior policies. The generated data sets can be repeatedly used during the learning process, which is computationally effective. The simulation results demonstrate the effectiveness of the proposed Q-learning algorithm.

关键词： adaptive dynamic programming ADP Q-learning reinforcement learning RL linear nonzerosum quadratic differential games policy iteration PI off-policy

来源：评论

学校读者我要写书评

暂无评论

Integrated design and performance optimization of three-electrode sliding discharge plasma power supply

引用

Plasma science and technology 2024年第11期26卷 152-161页

作者： Borui ZHENG Linwu WANG Jianbo ZHANG Shaojie QI Yuhong CHEN Haodong LIU Dongliang BIAN School of Automation and Information Engineering Xi’an University of TechnologyXi’an 710048People’s Republic of China Shaanxi Key Laboratory of Complex System Control and Intelligent Information Processing Xi’an 710048People’s Republic of China School of Mechanical and Precision Instrument Engineering Xi’an University of TechnologyXi’an 710048People’s Republic of China Science and Technology on Plasma Dynamics Laboratory Air Force Engineering UniversityXi’an 710038People’s Republic of China

The three-electrode sliding dielectric barrier discharge(TES-DBD) plasma actuator significantly enhances the ionization rate and momentum exchange between charged particles and neutral particles by incorporating a parallel DC electrode into the standard DBD design. This design improves the body force and induced jet velocity while allowing flexible control of the induced jet angle, overcoming the limitations of discharge extension and uncontrollable direction in traditional DBD plasma actuators. An integrated plasma power supply has been designed specifically for TES-DBD plasma actuators, streamlining the power supply management. The methodology involves designing the circuit topology for the TES-DBD power supply, followed by simulating and validating its operating principles using Multisim software. The operational performance of the power supply is evaluated through a comprehensive analysis of its electrical,thermal, and aerodynamic properties specific to TES-DBD plasma actuation.

关键词： plasma flow control dielectric barrier discharge three-electrode sliding discharge plasma power supply

来源：评论

学校读者我要写书评

暂无评论

Spatiotemporal evolution laws of sector-shaped dielectric-barrier-discharge plasma actuator

引用

Plasma science and technology 2024年第10期26卷 108-115页

作者： Borui ZHENG Jianbo ZHANG Shaojie QI Jianghua XU Yiche LI Yuanzhong JIN Dongliang BIAN School of Automation and Information Engineering Xi’an University of TechnologyXi’an 710048People’s Republic of China Shaanxi Key Laboratory of Complex System Control and Intelligent Information Processing Xi’an 710048People’s Republic of China School of Mechanical and Precision Instrument Engineering Xi’an University of TechnologyXi’an 710048People’s Republic of China Science and Technology on Plasma Dynamics Laboratory Air Force Engineering UniversityXi’an 710038People’s Republic of China

Dielectric barrier discharge(DBD)plasma actuators are widely used in active flow control due to their simple design and rapid ***,they need more effectiveness and discharge *** overcome these limitations,a sector-shaped dielectric barrier discharge(SS-DBD)plasma actuator with an adjustable jet angle was developed to enhance flow control *** flow field dynamics induced by the SS-DBD plasma actuator were quantitatively analyzed using particle image velocimetry(PIV).Experimental investigations showed that precise adjustments to the actuation voltage can modulate the maximum velocity of the induced ***,a quasi-linear relationship between the sector-shaped angles of the SS-DBD and the deflected jet angles was established,indicating that changes in the sector-shaped angles directly influence the direction of the deflected *** correlation enables precise control over jet angles,significantly enhancing flow control by adjusting the SS-DBD-PA's sector-shaped angle.

关键词： plasma flow control plasma actuator particle image velocimetry

来源：评论

学校读者我要写书评

暂无评论

A Variational Bayesian Labeled Multi-Bernoulli Filter for Tracking with Inverse Wishart Distribution

A Variational Bayesian Labeled Multi-Bernoulli Filter for Tr...

引用

International Conference on Information Fusion

作者： Jinran Wang Zhongliang Jing Peng Dong Jin Cheng School of Aeronautics and Astronautics Shanghai Jiao Tong University Shanghai China Science and Technology on Complex System Control and Intelligent Agent Cooperation Laboratory Beijing Electro-mechanical Engineering Institute Beijing China

In multi-target tracking (MTT), the imprecise model for sensor characteristics might result in poor performance. The Variational Bayesian labeled multi-Bernoulli (VB-LMB) filter based on Gamma distribution can handle this problem. However, the predictive likelihood of the existing VB-LMB filter is simply treated as a Gaussian, which is inaccurate. In this paper, a VB-LMB filter with inverse Wishart distribution is presented to perform MTT under the unknown sensor characteristics. The measurement noise covariance is modeled as an inverse Wishart (IW) distribution. This distribution has potential to deal with the full noise covariance matrix compared with the Gamma distribution. Since the state and the measurement noise covariance are coupled, the updated equation can be solved by variational Bayesian (VB) method. The predictive likelihood is calculated via minimizing the Kullback-Leibler divergence by the VB lower bound. A MTT scenario is used to evaluate the proposed method. Simulation results show that our approach has better performance than the existing VB-LMB filter with the Gamma distribution.

关键词： Radio frequency Noise measurement Bayes methods Covariance matrices Target tracking Extraterrestrial measurements

来源：评论

学校读者我要写书评

暂无评论

Study on Scattering Signature Signal Modeling Method of Sea-surface Target for Bi-static Synthetic Aperture Radar

Study on Scattering Signature Signal Modeling Method of Sea-...

引用

2019 IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2019

作者： Guijier, DIao Hong, Ni Yajing, Zhang Tianming, Zhan Xiaojian, Xu Science and Technology on Complex System Control and Intelligent Agent Cooperation Laboratory Beijing China Beijing Electro-mechanical Engineering Institute Beijing China Datang Mobile Communication Equipment Co. Ltd. Datang Telecom Group Beijing China Beijing Aerospace Smart Manufacturing Technology Development Co.Ltd. Beijing China Electronic Information Engineering College Beihang University Beijing China

ISBN: (纸本)9781728123455

Based on the coupling scattering mechanism between the ship and sea surface, a scattering signature modeling method of sea-surface target for bi-static imaging radar is proposed, considering the modulation effects of sea-surface forcing to ship targets. The bi-static scattering signature signal for sea-surface target is modeled, in conjunction with high frequency asymptotic techniques for electromagnetic (EM) scattering calculation, the multi-path EM scattering model, the time-evolving complex reflection coefficient model and the ship motion dynamics. The time-varying scattering signatures for a typical ship on time-evolving sea-surface are simulated and analyzed. © 2019 IEEE.

关键词： Radar imaging

来源：评论

学校读者我要写书评

暂无评论

An SIE Formulation With Loop Analysis for Large-Scale Arbitrarily Shaped Interconnects

An SIE Formulation With Loop Analysis for Large-Scale Arbitr...

引用

Antennas and Propagation Society International Symposium

作者： Zekun Zhu Ningbo Gong Guijie Diao Shunchuan Yang School of Electronic and Information Engineering Beihang University Beijing China Beijing Electro-mechanical Engineering Institute Beijing China Science and Technology on Complex System Control and Intelligent Agent Cooperation Laboratory China

A magneto-quasi-static (MQS) surface integral equation (SIE) formulation with loop analysis is proposed to extract the impedance of interconnects in packages. The loop analysis is developed with an independent and complete set of unknowns according to the graph theory, which can significantly reduce the dimension of the final matrix. With the pre-corrected fast Fourier Transform (pFFT), large-scale interconnects can be efficiently modelled. A practical example in packages is carried out to validate the effectiveness and scalability of the proposed formulation. Results show that the proposed formulation is accurate and flexible to model complex interconnects in packages compared with the industrial solver.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Magnetic Microrobots Fabricated by Photopolymerization and Assembly

引用

Cyborg and Bionic systems 2023年第1期4卷 41-46页

作者： Xiyue Liang Yue Zhao Dan Liu Yan Deng Tatsuo Arai Masaru Kojima Xiaoming Liu Key Laboratory of Biomimetic Robots and Systems Ministry of EducationState Key Laboratory of Intelligent Control and Decision of Complex SystemBeijing Advanced Innovation Center for Intelligent Robots and Systemsand School of Mechatronical EngineeringBeijing Institute of TechnologyBeijing 100081China Center for Neuroscience and Biomedical Engineering The University of Electro-CommunicationsTokyo 182-8585Japan Department of Materials Engineering Science Osaka UniversityOsaka 560-8531Japan

Magnetic soft microrobots have great potential to access narrow spaces and conduct multiple tasks in the biomedical *** now,drug delivery,microsurgery,disease diagnosis,and dredging the blocked blood vessel have been realized by magnetic soft microrobots in vivo or in ***,as the tasks become more and more complex,more functional units have been embedded in the body of the developed magnetic *** magnetic soft microrobots with complex designed geometries,mechanisms,and magnetic orientation are now greatly challenging the fabrication of the magnetic *** this paper,we propose a new method combining photopolymerization and assembly for the fabrication of magnetic soft *** the micro-hand assembly system,magnetic modules with different shapes and materials are firstly arrayed with precise position and orientation ***,the developed photopolymerization system is employed to fix and link these modules with soft *** on the proposed fabrication method,3 kinds of soft magnetic microrobots were fabricated,and the fundamental locomotion was *** believe that the presented fabrication strategy could help accelerate the clinical application of magnetic microrobots.

关键词： Magnetic system precise

来源：评论

学校读者我要写书评

暂无评论

Low-Cost INS/GNSS Integration Algorithm Aided by Multi-Constraints Applied to Vehicle Navigation

Low-Cost INS/GNSS Integration Algorithm Aided by Multi-Const...

引用

IEEE International Conference on control and Robotics Engineering (ICCRE)

作者： Baoshuang Ge Hai Zhang Wenxing Fu Jieling Chen School of Automation Science and Electrical Engineering Beihang University Beijing China Science and Technology on Complex System Control and Intelligent Agent Cooperation Laboratory Beijing China China Ship Development and Design Center Wuhan China

ISBN: (数字)9781728167916

ISBN: (纸本)9781728167923

The low-cost inertial navigation system/global navigation satellite system (INS/GNSS) integration has been widely used to vehicle navigation. However, the positioning performance often declines due to the weak satellite signals. This paper presents a new approach to improve the accuracy of the vehicle navigation. In contrast to the current methods, a new velocity constraint model is developed to aid the estimation of the navigation errors. The altitude accuracy of GNSS is challenged in comparison with its position in the horizonal plane. Thus, an auxiliary low-cost barometer is used to obtain the height as well. The experimental results demonstrate the benefit of the proposed multi-constraints aiding algorithm.

关键词： Global navigation satellite system Global Positioning system Kalman filters Receivers Sea measurements

来源：评论

学校读者我要写书评

暂无评论

Flight Parameter Prediction and Fault Propagation based on Machine Learning and Symbolic Directed Graph

Flight Parameter Prediction and Fault Propagation based on M...

引用

International Symposium on Autonomous systems (ISAS)

作者： Wenzhuo Li Kun Guo Yuehua Cheng Hengsong Hu Cheng Xu Ziquan Yu College of Automation Engineering Nanjing University of Aeronautics and Astronautics Nanjing China Science and Technology on Complex System Control and Intelligent Agent Cooperation Laboratory Beijing Institute of Mechanical and Electrical Engineering Beijing China

Fault influence and propagation analysis of flight vehicle systems is an important element of flight vehicle health management and also an important problem to be solved. A fault influence model based on data-driven is established, including a prediction model of flight parameters under fault, a dynamic influence path, and an influence degree model. Based on the historical experimental data, a long and short-term memory neural network (LSTM) model is proposed to predict the time-series data of each flight parameter of the flight vehicle under fault; based on the prediction results, a symbolic directed graph (SDG) is used to describe the fault of the flight vehicle system, and then introduce the concept of a compatible path with time-series characteristics to describe the dynamic propagation process of the fault. The case shows that the method proposed in this paper enables qualitative and quantitative analysis of the fault influence, and can reasonably describe the fault propagation path and influence characteristics.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Distance-based separability criterion of ROI in classification of farmland hyper-spectral images

引用

International Journal of Agricultural and Biological Engineering 2017年第5期10卷 177-185页

作者： Tang Jinglei Miao Ronghui Zhang Zhiyong Xin Jing Wang Dong College of Information Engineering Northwest A&F UniversityYangling 712100ShaanxiChina Shaanxi Key Laboratory of Complex System Control and Intelligent Information Processing Xi’an University of TechnologyXi’an 710048China College of Information Science and Engineering Shanxi Agricultural UniversityTaigu 030801ShanxiChina

The hyper-spectral image contains spectral and spatial information,which increases the ability and precision of objects *** the classification value of hyper-spectral imaging technology within various applications,users often find it difficult to effectively apply in practice because of the effect of light,temperature and wind in outdoor *** research presented a new classification model for outdoor farmland objects based on near-infrared(NIR)hyper-spectral *** involves two steps including region of interest(ROI)acquisition and establishment of classifiers.A distance-based method for quantitative analysis was proposed to optimize the reference pixels in ROI acquisition *** maximum likelihood(ML)and support vector machine(SVM)were used for farmland objects *** performance of the proposed method showed that the total classification accuracy based on the reference pixels was over 97.5%,of which the SVM-M model could reach 99.5%.The research provided an effective method for outdoor farmland image classification.

关键词： distance-based separability criterion near-infrared hyper-spectral image ROI farmland image classification

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：