检索结果-内蒙古大学图书馆

Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced Control Applications

IEEE/CAA Journal of Automatica Sinica 2024年第1期11卷 18-36页

作者： Ding Wang Ning Gao Derong Liu Jinna Li Frank L.Lewis IEEE the Faculty of Information Technology Beijing Key Laboratory of Computational Intelligence and Intelligent SystemBeijing Laboratory of Smart Environmental Protectionand Beijing Institute of Artificial IntelligenceBeijing University of TechnologyBeijing 100124China the School of System Design and Intelligent Manufacturing Southern University of Science and TechnologyShenzhen 518055China the Department of Electrical and Computer Engineering University of Illinois at ChicagoChicago IL 60607 USA the School of Information and Control Engineering Liaoning Petrochemical UniversityFushun 113001China the UTA Research Institute the University of Texas at ArlingtonArlington TX 76118 USA

Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, ***, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation ***, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.

关键词： Adaptive dynamic programming(ADP) advanced control complex environment data-driven control event-triggered design intelligent control neural networks nonlinear systems optimal control reinforcement learning(RL)

来源：评论

学校读者我要写书评

暂无评论

UAV-Assisted Dynamic Avatar Task Migration for Vehicular Metaverse Services: A Multi-Agent Deep Reinforcement Learning Approach

引用

IEEE/CAA Journal of Automatica Sinica 2024年第2期11卷 430-445页

作者： Jiawen Kang Junlong Chen Minrui Xu Zehui Xiong Yutao Jiao Luchao Han Dusit Niyato Yongju Tong Shengli Xie IEEE School of Automation Guangdong University of TechnologyGuangzhou 510006China 111 Center for Intelligent Batch Manufacturing based on IoT Technology Guangzhou 510006China Key Laboratory of Intelligent Information Processing and System Integration of IoT Ministry of EducationGuangzhou 510006China School of Computer Science and Engineering Nanyang Technological UniversitySingaporeSingapore Pillar of Information Systems Technology and Design Singapore University of Technology and DesignSingaporeSingapore College of Communication Engineering Army Engineering University of PLANanjing 210007China National Natural Science Foundation of China Beijing 100085China Key Laboratory of Intelligent Detection and IoT in Manufacturing Ministry of EducationGuangzhou 510006China Guangdong Key Laboratory of IoT Information Technology Guangzhou 510006China

Avatars, as promising digital representations and service assistants of users in Metaverses, can enable drivers and passengers to immerse themselves in 3D virtual services and spaces of UAV-assisted vehicular Metaverses. However, avatar tasks include a multitude of human-to-avatar and avatar-to-avatar interactive applications, e.g., augmented reality navigation,which consumes intensive computing resources. It is inefficient and impractical for vehicles to process avatar tasks locally. Fortunately, migrating avatar tasks to the nearest roadside units(RSU)or unmanned aerial vehicles(UAV) for execution is a promising solution to decrease computation overhead and reduce task processing latency, while the high mobility of vehicles brings challenges for vehicles to independently perform avatar migration decisions depending on current and future vehicle status. To address these challenges, in this paper, we propose a novel avatar task migration system based on multi-agent deep reinforcement learning(MADRL) to execute immersive vehicular avatar tasks dynamically. Specifically, we first formulate the problem of avatar task migration from vehicles to RSUs/UAVs as a partially observable Markov decision process that can be solved by MADRL algorithms. We then design the multi-agent proximal policy optimization(MAPPO) approach as the MADRL algorithm for the avatar task migration problem. To overcome slow convergence resulting from the curse of dimensionality and non-stationary issues caused by shared parameters in MAPPO, we further propose a transformer-based MAPPO approach via sequential decision-making models for the efficient representation of relationships among agents. Finally, to motivate terrestrial or non-terrestrial edge servers(e.g., RSUs or UAVs) to share computation resources and ensure traceability of the sharing records, we apply smart contracts and blockchain technologies to achieve secure sharing management. Numerical results demonstrate that the proposed approach

关键词： Avatar blockchain metaverses multi-agent deep reinforcement learning transformer UAVs

来源：评论

学校读者我要写书评

暂无评论

CRD-CGAN:category-consistent and relativistic constraints for diverse text-to-image generation

引用

Frontiers of computer science 2024年第1期18卷 61-75页

作者： Tao HU Chengjiang LONG Chunxia XIAO College of Intelligent Systems Science and Engineering Hubei Minzu UniversityEnshi 445000China School of Computer Science Wuhan UniversityWuhan 430072China Key Laboratory of Performing Art Equipment&System Technology Ministry of Culture and TourismBeijing 100007China Meta Reality Labs BurlingameCA94010USA

Generating photo-realistic images from a text description is a challenging problem in computer *** works have shown promising performance to generate synthetic images conditional on text by Generative Adversarial Networks(GANs).In this paper,we focus on the category-consistent and relativistic diverse constraints to optimize the diversity of synthetic *** on those constraints,a category-consistent and relativistic diverse conditional GAN(CRD-CGAN)is proposed to synthesize K photo-realistic images *** use the attention loss and diversity loss to improve the sensitivity of the GAN to word attention and ***,we employ the relativistic conditional loss to estimate the probability of relatively real or fake for synthetic images,which can improve the performance of basic conditional ***,we introduce a category-consistent loss to alleviate the over-category issues between K synthetic *** evaluate our approach using the Caltech-UCSD Birds-200-2011,Oxford 102 flower and MS COCO 2014 datasets,and the extensive experiments demonstrate superiority of the proposed method in comparison with state-of-the-art methods in terms of photorealistic and diversity of the generated synthetic images.

关键词： text-to-image diverse conditional GAN relativi-stic category-consistent

来源：评论

学校读者我要写书评

暂无评论

Stochastic Unit Commitment with High-Penetration Offshore Wind Power Generation in Typhoon Scenarios

引用

Journal of Modern Power systems and Clean Energy 2024年第2期12卷 535-546页

作者： Yanqi Liu Dundun Liu Hongcai Zhang State Key Laboratory of Internet of Things for Smart City and Department of Electrical and Computer Engineering University of MacaoMacao 999078China University of Macao Zhuhai UM Science and Technology Research Institute ZhuhaiChina

To tackle the energy crisis and climate change,wind farms are being heavily invested in across the *** China's coastal areas,there are abundant wind resources and numerous offshore wind farms are being *** secure operation of these wind farms may suffer from typhoons,and researchers have studied power system operation and resilience enhancement in typhoon ***,the intricate movement of a typhoon makes it challenging to evaluate its spatial-temporal *** published papers only consider predefined typhoon trajectories neglecting *** address this challenge,this study proposes a stochastic unit commitment model that incorporates high-penetration offshore wind power generation in typhoon *** adopts a data-driven method to describe the uncertainties of typhoon trajectories and considers the realistic anti-typhoon mode in offshore wind farms.A two-stage stochastic unit commitment model is designed to enhance power system resilience in typhoon *** formulate the model into a mixed-integer linear programming problem and then solve it based on the computationally-efficient progressive hedging algorithm(PHA).Finally,numerical experiments validate the effectiveness of the proposed method.

关键词： Unit commitment two-stage stochastic programming offshore wind farm typhoon

来源：评论

学校读者我要写书评

暂无评论

Simultaneous segmentation and classification of colon cancer polyp images using a dual branch multi-task learning network

引用

Mathematical Biosciences and Engineering 2024年第2期21卷 2024-2049页

作者： Li, Chenqian Liu, Jun Tang, Jinshan School of Computer Science and Technology Wuhan University of Science and Technology Wuhan430065 China Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial System Wuhan430065 China Department of Health Administration and Policy College of Public Health George Mason University FairfaxVA22030 United States

Accurate classification and segmentation of polyps are two important tasks in the diagnosis and treatment of colorectal cancers. Existing models perform segmentation and classification separately and do not fully make use of the correlation between the two tasks. Furthermore, polyps exhibit random regions and varying shapes and sizes, and they often share similar boundaries and backgrounds. However, existing models fail to consider these factors and thus are not robust because of their inherent limitations. To address these issues, we developed a multi-task network that performs both segmentation and classification simultaneously and can cope with the aforementioned factors effectively. Our proposed network possesses a dual-branch structure, comprising a transformer branch and a convolutional neural network (CNN) branch. This approach enhances local details within the global representation, improving both local feature awareness and global contextual understanding, thus contributing to the improved preservation of polyp-related information. Additionally, we have designed a feature interaction module (FIM) aimed at bridging the semantic gap between the two branches and facilitating the integration of diverse semantic information from both branches. This integration enables the full capture of global context information and local details related to polyps. To prevent the loss of edge detail information crucial for polyp identification, we have introduced a reverse attention boundary enhancement (RABE) module to gradually enhance edge structures and detailed information within polyp regions. Finally, we conducted extensive experiments on five publicly available datasets to evaluate the performance of our method in both polyp segmentation and classification tasks. The experimental results confirm that our proposed method outperforms other state-of-the-art methods. ©2024 the Author(s), licensee AIMS Press.

关键词： Classification (of information)

来源：评论

学校读者我要写书评

暂无评论

HCU-Net: An Efficient Fully Convolutional Neural Network for Thyroid Nodules Ultrasound Image Segmentation

HCU-Net: An Efficient Fully Convolutional Neural Network for...

引用

2024 IEEE International Conference on systems, Man, and Cybernetics, SMC 2024

作者： Ren, Mengxi Liu, Jun School of Computer Science and Technology Wuhan University of Science and Technology Wuhan China Wuhan University of Science and Technology Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial System Wuhan China

ISBN: (纸本)9781665410205

Thyroid nodules, which can manifest as solitary or multiple growths, are among the most prevalent diseases with a high incidence rate. When examining thyroid nodules, ultrasound is typically the first step. Ultrasound image segmentation of thyroid nodules can assist physicians in diagnosis. However, the following three factors limit the development of thyroid nodule segmentation: (1) most of the existing studies optimize the segmentation of single nodules, and the incidence of multiple nodules is higher, so the segmentation of multiple nodules is also very important;(2) the ultrasound image of thyroid nodules is difficult to segment because of its low resolution and fuzzy boundary;(3) Due to the small data set of thyroid nodule ultrasound, in such a small dataset, attention mechanisms may be prone to overfitting, resulting in poorer generalization performance. Therefore, the attention-based model may not be suitable for the segmentation of thyroid nodules. Hence, we propose Hybrid Convolutional U-Net (HCU-Net), a simple and strong fully convolutional neural network for the segmentation of single or multiple thyroid nodules. HCU-Net incorporates a large receptive field to ensure accurate and stable segmentation. Specifically, we design Hybrid Branch Block to enhance the network's feature extraction capability for single or multiple nodules in ultrasound images by integrating multi-scale features. Furthermore, we add Enhanced ConvNeXt Blocks to the U-Net's final layer, enabling the extraction of global contextual information for segmentation performance. The Experimental results show that our proposed method can effectively improve these issues on two publicly available datasets. In addition, compared to attention-based models, our network is simpler and more suitable for small datasets like ultrasound images. © 2024 IEEE.

关键词： Ultrasonic imaging

来源：评论

学校读者我要写书评

暂无评论

DIG: Improved DINO for Graffiti Detection

引用

IEEE Transactions on systems, Man, and Cybernetics: systems 2025年第5期55卷 3557-3569页

作者： Wang, Bingshu Mao, Qianchen Liu, Aifei Chen, Long Chen, C. L. Philip Northwestern Polytechnical University School of Software Xi’an710129 China Shenzhen University Guangdong Key Laboratory of Intelligent Information Processing Shenzhen Key Laboratory of Media Security Shenzhen518060 China University of Macao Department of Computer and Information Science China South China University of Technology School of Computer Science and Engineering Guangzhou510641 China

Graffiti detection is essential in historic building protection and urban neighborhood management. Graffiti detection has made significant progress in recent years based on the development of deep learning. However, small-scale graffiti, interference from the background, and the false detection of word parts in graffiti make it a challenging problem. This article proposes a Transformer-based high-precision graffiti detection method, namely DIG. Precisely, it consists of three modules: 1) Spatial query selection (SQS), scale-aware IoU loss (SIL);2) Denoising Task with binary contrastive denoising (BCDN);and 3) IoU-guided box denoising (IBD) modules. To detect small-scale graffiti, this paper proposes SIL to help the loss function to perceive small-scale graffiti and large-scale graffiti fairly. To reduce the false detection of word parts, this article presents the SQS module, which integrates spatial information into the query selection process of the Encoder to filter out falsely detected bounding boxes within the graffiti. To reduce the interference from the background, this article introduces a denoising task with BCDN and IBD modules, improving the model’s ability to distinguish graffiti from the background and accurately select appropriate bounding boxes. A large number of experimental results on the STORM dataset show that our method achieves state-of-the-art results with an AP50 of 87.9%. Moreover, DIG achieved competitive results on the FineFM dataset for mask detection. This indicates that DIG can also be conveniently transferred to detect other scenarios. © 2013 IEEE.

关键词： Historic preservation

来源：评论

学校读者我要写书评

暂无评论

Toward Comprehensive Semantic Prompt for Region Contrastive Learning Underwater Image Enhancement

Toward Comprehensive Semantic Prompt for Region Contrastive ...

引用

2025 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2025

作者： Wang, Xiao Fu, Yongsheng Wang, Wei Liu, Wei School of Computer Science and Technology Wuhan University of Science and Technology Wuhan China Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System China

ISBN: (纸本)9798350368741

Underwater image enhancement (UIE) focuses on mitigating image quality degradation due to light absorption and scattering. However, most existing methods enhance images via a global and uniform manner, neglecting the inherent semantic information in different regions, which may cause the network to easily deviate from the region's original color. Moreover, these methods typically rely on clear images to guide network convergence, a process constrained by the limited availability of real-world datasets, making it extremely challenging to train enhancement models for various degradations. To address these challenges, this paper introduces a semantic guidance and region contrastive constraints network (SRCNet). Initially, we propose a semantic-aware RWKV (Receptance Weighted key Value) block and a semantic prompt regularization module. These components leverage intra-target semantic correlations to preserve image details and colors within a global perceptual framework, while employing focal loss to emphasize the restoration of severely degraded regions. Subsequently, we introduce a region contrastive learning method that effectively utilizes negative samples to precisely capture features sensitive to degradation factors, thereby fostering robust feature distributions. Finally, experimental results demonstrate that our method outperforms existing state-of-the-art (SOTA) approaches. © 2025 IEEE.

关键词： contrastive learning rwkv semantic prompt Underwater image enhancement

来源：评论

学校读者我要写书评

暂无评论

Multi-Scale and Improved Skip Connections Network for Skin Lesion Segmentation 9

Multi-Scale and Improved Skip Connections Network for Skin L...

引用

9th International Conference on intelligent Computing and Signal Processing, ICSP 2024

作者： Zhang, Botao Chen, Jun College of Computer Science and Technology Wuhan University of Science and Technology Wuhan China Wuhan University of Science and Technology Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System Wuhan China

ISBN: (纸本)9798350376548

To solve the problem that the current skin lesion segmentation networks have a poor segmentation accuracy when lesion areas are of different shapes and sizes and low contrast at the edge areas, based on U-Net, we present a skin lesion segmentation network based on multi-scale and improved skip connections. Firstly, a multi-scale feature enhancement module is designed to replace the U-Net's 3× 3 convolution blocks, which can improve the feature extraction ability of the network about lesion areas of different shapes and sizes. Secondly, a lesion attention module is introduced into the skip connection to improve the semantic expression of low-level features and the location attention of high-level features, which can improve the fine-grained information transmission efficiency at the skip connection. Finally, a new hybrid loss function is designed to calculate the label and the edge loss of lesion areas, which improves the ability of the network to segment lesion areas and edges. Experiments are conducted on the ISIC2017 and ISIC2018 datasets, and the results prove that our method have a higher segmentation accuracy in skin lesion segmentation. © 2024 IEEE.

关键词： Problem solving

来源：评论

学校读者我要写书评

暂无评论

A Secure and Cost-Effective Training Framework Atop Serverless Computing for Object Detection in Blasting

引用

computer Modeling in Engineering & sciences 2024年第5期139卷 2139-2154页

作者： Tianming Zhang Zebin Chen Haonan Guo Bojun Ren Quanmin Xie Mengke Tian Yong Wang Department of Computer and Science Shanghai Jiaotong UniversityShanghai200240China Aerospace System Engineering Shanghai Shanghai200240China State Key Laboratory of Precision Blasting Jianghan UniversityWuhan430056China Beijing Microelectronics Technology Institute Beijing100076China

The data analysis of blasting sites has always been the research goal of relevant *** rise of mobile blasting robots has aroused many researchers’interest in machine learning methods for target detection in the field of *** Computing can provide a variety of computing services for people without hardware foundations and rich software development experience,which has aroused people’s interest in how to use it in the field ofmachine *** this paper,we design a distributedmachine learning training application based on the AWS Lambda *** on data parallelism,the data aggregation and training synchronization in Function as a Service(FaaS)are effectively *** also encrypts the data set,effectively reducing the risk of data *** rent a cloud server and a Lambda,and then we conduct experiments to evaluate our *** results indicate the effectiveness,rapidity,and economy of distributed training on FaaS.

关键词： Serverless computing object detection blasting

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：