检索结果-内蒙古大学图书馆

A Decoupling Paradigm with Prompt Learning for Remote Sensing image Change Captioning

学校读者我要写书评

暂无评论

TechRxiv

TechRxiv 2023年

作者： Liu, Chenyang Zhao, Rui Chen, Jianqi Qi, Zipeng Zou, Zhengxia Shi, Zhenwei Rhe Image Processing Center School of Astronautics The Beijing Key Laboratory of Digital Media The State Key Laboratory of Virtual Reality Technology and Systems Beihang University Beijing100191 China The Shanghai Artificial Intelligence Laboratory Shanghai200232 China The Department of Guidance Navigation and Control School of Astronautics Beihang University Beijing100191 China Shanghai Artificial Intelligence Laboratory Shanghai200232 China

Remote sensing image change captioning (RSICC) is a novel task that aims to describe the differences between bitemporal images by natural language. Previous methods ignore a significant specificity of the task: the difficulty of RSICC is different for unchanged and changed image pairs. They process the unchanged and changed image pairs in a coupled way, which usually causes confusion for change captioning. In this paper, we decouple the task into two issues to ease it: whether and what changes have occurred. An image-level classifier performs binary classification to address the first issue. A feature-level encoder contributes to extracting discriminative features to help the caption generation module address the second issue. Besides, for caption generation, we utilize prompt learning to introduce pre-trained large language models (LLMs) into the RSICC task. A multi-prompt learning strategy is proposed to generate a set of unified prompts and a class-specific prompt conditioned on the image-level classifier’s results. The strategy can prompt a pre-trained LLM to know whether changes exist and generate captions. Finally, the multiple prompts and the visual features of the feature-level encoder are fed into a frozen LLM for language generation. Compared with previous methods, our method can leverage the powerful abilities of the pre-trained LLM in language to generate plausible captions, which is free of training. Extensive experiments show that our method is effective and achieves state-of-the-art performance. Besides, an additional experiment demonstrates that our decoupling paradigm is more promising than the previous coupled paradigm for the RSICC task. We will make our codebase publicly available to facilitate future research at https://***/Chen-Yang-Liu/PromptCC © 2023, CC BY-NC-SA.

关键词： Learning systems

Coordinated Navigation control of Cross-Domain Unmanned Systems via Guiding Vector Fields

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Hu, Bin-Bin Zhang, Hai-Tao Liu, Bin Ding, Jianing Xu, Yifan Luo, Chuanshang Cao, Haosen The School of Artificial Intelligence and Automation The Engineering Research Center of Autonomous Intelligent Unmanned Systems The Key Laboratory of Image Processing and Intelligent Control The State Key Lab of Digital Manufacturing Equipment and Technology Huazhong University of Science and Technology Wuhan430074 China Dongguan University of Technology Dongguan523106 China

This paper proposes a distributed guiding-vector-field (DGVF) controller for cross-domain unmanned systems (CDUSs) consisting of heterogeneous unmanned aerial vehicles (UAVs) and unmanned surface vehicles (USVs), to achieve coordinated navigation whereas maneuvering along their prescribed paths. In particular, the DGVF controller provides a hierarchical architecture of an upper-level heterogeneous guidance velocity controller and a lower-level signal tracking regulator. Therein, the upper-level controller is to govern multiple heterogeneous USVs and UAVs to approach and maneuver along the prescribed paths and coordinate the formation simultaneously, whereas the low-level regulator is to track the corresponding desired guidance signals provided by the upper-level module. Significantly, the heterogeneous coordination among neighboring UAVs and USVs is achieved merely by the lightweight communication of a scalar (i.e., the additional virtual coordinate), which substantially decreases the communication and computational costs. Sufficient conditions assuring asymptotical convergence of the closed-loop system are derived in presence of the exponentially vanishing tracking errors. Finally, real-lake experiments are conducted on a self-established cross-domain heterogeneous platform consisting of three M-100 UAVs, two HUSTER-16 USVs, a HUSTER-12C USV, and a WiFi 5G wireless communication station to verify the effectiveness of the present DGVF controller. Copyright © 2023, The Authors. All rights reserved.

关键词： Air navigation

Vehicle Scheduling with Exact Minimum Fleet-Size

学校读者我要写书评

暂无评论

SSRN

SSRN 2022年

作者： Shen, Yindong Li, Yuanyuan School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Key Laboratory of Image Processing and Intelligent Control Huazhong University of Science and Technology Ministry of Education China

Vehicle scheduling plays a profound role in public transit planning. Vehicle scheduling problem (VSP) addresses the task of assigning vehicles to cover timetabled trips to minimize the fleet-size as well as operating costs. The fixed cost of acquiring and maintaining vehicles is much more expensive than the operating cost. It is of great theoretical and practical significance to construct the vehicle schedules with the exact minimum fleet-size (EMF). The theorem that the EMF is equal to the maximum incompatible degree of the timetabled trips is first proposed and proved. Based on the theorem and time compatibility between any two trips, this paper theoretically examines vehicle scheduling with EMF. Specifically, construction procedures of schedules with EMF are provided for VSP in a specific case as well as the general case. Furthermore, sensitivity analysis of the EMF and the schedule with EMF are carried out. The EMF is possible to decrease by 1 if a trip is deleted or the start/end time of a trip is changed in the timetable. © 2022, The Authors. All rights reserved.

关键词： Sensitivity analysis

3D Instances as 1D Kernels

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Wu, Yizheng Shi, Min Du, Shuaiyuan Lu, Hao Cao, Zhiguo Zhong, Weicai Key Laboratory of Image Processing and Intelligent Control Ministry of Education School of AIA Huazhong University of Science and Technology China Huawei CBG Consumer Cloud Service Search & Maps BU China

We introduce a 3D instance representation, termed instance kernels, where instances are represented by one-dimensional vectors that encode the semantic, positional, and shape information of 3D instances. We show that instance kernels enable easy mask inference by simply scanning kernels over the entire scenes, avoiding the heavy reliance on proposals or heuristic clustering algorithms in standard 3D instance segmentation pipelines. The idea of instance kernel is inspired by recent success of dynamic convolutions in 2D/3D instance segmentation. However, we find it non-trivial to represent 3D instances due to the disordered and unstructured nature of point cloud data, e.g., poor instance localization can significantly degrade instance representation. To remedy this, we construct a novel 3D instance encoding paradigm. First, potential instance centroids are localized as candidates. Then, a candidate merging scheme is devised to simultaneously aggregate duplicated candidates and collect context around the merged centroids to form the instance kernels. Once instance kernels are available, instance masks can be reconstructed via dynamic convolutions whose weights are conditioned on instance kernels. The whole pipeline is instantiated with a dynamic kernel network (DKNet). Results show that DKNet outperforms the state of the arts on both ScanNetV2 and S3DIS datasets with better instance localization. Code is available: https://***/W1zheng/DKNet. Copyright © 2022, The Authors. All rights reserved.

关键词： Pipelines

Short-Term Hybrid Prognostics of Fuel Cells: A Comparative and Improvement Study

学校读者我要写书评

暂无评论

SSRN

SSRN 2024年

作者： Sheng, Chuang Fu, Jun Zu, YanMin Deng, ZhongHua Li, Xi School of Artificial Intelligence and Automation Key Laboratory of Image Processing and Intelligent Control Education Ministry Huazhong University of Science and Technology Wuhan430074 China Shenzhen Huazhong University of Science and Technology Research Institute Shenzhen518055 China School of Electronic Information Engineering Jingchu University of Technology Jingmen448000 China

Accurately predicting the performance degradation trend of fuel cells helps take measures in advance and prolong the service life of the stack, which led to the creation of a novel hybrid forecasting approach. The first grey model prediction method based on residual exponential smoothing optimization (ES-R-GM) can capture the voltage deterioration trend. The integration of two different ES techniques, specifically the double ES (ES2) and cubic ES (ES3), is explored to investigate their effect on improving the predictive accuracy of the GM model. The second method of the adaptive network fuzzy inference system (ANFIS) can characterize local nonlinear behaviour. The simulated annealing (SA) algorithm is utilized to optimize ANFIS results under different fuzzy rule selection strategies. The outcomes of the two types of prediction methods mentioned above are combined to create a hybrid prediction using the data fusion method and the moving window technique. Different hybrid methods are evaluated under general conditions and further detailed optimization. The proposed hybrid framework is verified by the data obtained from the experimental platform. Moreover, when applied to consistent public datasets, the hybrid approach maintains its robustness and accuracy compared with other prognostic methods. © 2024, The Authors. All rights reserved.

关键词： Simulated annealing

Tracing Intricate Cues in Dialogue: Joint Graph Structure and Sentiment Dynamics for Multimodal Emotion Recognition

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Jiang Wang, Xiaoping Zeng, Zhigang The School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China The Institute of Artificial Intelligence Huazhong University of Science and Technology Wuhan430074 China The Hubei Key Laboratory of Brain-Inspired Intelligent Systems Huazhong University of Science and Technology Wuhan430074 China The Key Laboratory of Image Processing and Intelligent Control Huazhong University of Science and Technology Ministry of Education Wuhan430074 China

Multimodal emotion recognition in conversation (MERC) has garnered substantial research attention recently. Existing MERC methods face several challenges: (1) they fail to fully harness direct inter-modal cues, possibly leading to less-than-thorough cross-modal modeling;(2) they concurrently extract information from the same and different modalities at each network layer, potentially triggering conflicts from the fusion of multi-source data;(3) they lack the agility required to detect dynamic sentimental changes, perhaps resulting in inaccurate classification of utterances with abrupt sentiment shifts. To address these issues, a novel approach named GraphSmile is proposed for tracking intricate emotional cues in multimodal dialogues. GraphSmile comprises two key components, i.e., GSF and SDP modules. GSF ingeniously leverages graph structures to alternately assimilate inter-modal and intra-modal emotional dependencies layer by layer, adequately capturing cross-modal cues while effectively circumventing fusion conflicts. SDP is an auxiliary task to explicitly delineate the sentiment dynamics between utterances, promoting the model’s ability to distinguish sentimental discrepancies. Furthermore, GraphSmile is effortlessly applied to multimodal sentiment analysis in conversation (MSAC), forging a unified multimodal affective model capable of executing MERC and MSAC tasks. Empirical results on multiple benchmarks demonstrate that GraphSmile can handle complex emotional and sentimental patterns, significantly outperforming baseline models. Copyright © 2024, The Authors. All rights reserved.

关键词： Emotion Recognition

Operator-Adapted Evolutionary Large-Scale Multiobjective Optimization for Voltage Transformer Ratio Error Estimation 11th

学校读者我要写书评

暂无评论

Operator-Adapted Evolutionary Large-Scale Multiobjective Opt...

11th International Conference on Evolutionary Multi-Criterion Optimization, EMO 2021

作者： Huang, Changwu Li, Lianghao He, Cheng Cheng, Ran Yao, Xin Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation Department of Computer Science and Engineering Southern University of Science and Technology Shenzhen518055 China Key Laboratory of Image Information Processing and Intelligent Control of Education Ministry of China School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China

ISBN: (纸本)9783030720612

Large-scale multiobjective optimization problems (LSMOPs) exist widely in real-world applications, and they are challenging for existing evolutionary algorithms due to their massive volume of search space. Despite that a number of large-scale multiobjective evolutionary algorithms (LSMOEAs) have been proposed in recent years, their effectiveness in solving LSMOPs remains unsatisfactory. One main reason is that most existing LSMOEAs may fail to balance convergence enhancement and diversity maintenance, especially for solving real-world problems. To address this issue, we propose to use a hybridized LSMOEA with adaptive operator selection (AOS) to handle real-world LSMOPs. Specifically, the proposed hybridized LSMOEA with AOS (AOS-LSMOEA) includes multiple different offspring generation and environmental selection strategies extracted from some existing LSMOEAs. Then it uses the AOS to adaptively determine the application rates of different offspring generation and environmental selection operators in an online manner. The proposed approach is capable of taking advantage of existing LSMOEAs, and the AOS enables the algorithm to choose suitable operators for solving different LSMOPs. In this study, the proposed algorithm is expected to solve the voltage transformer ratio error estimation (TREE) problems effectively. Experimental results show that AOS-LSMOEA achieves significant performance improvement due to the hybridization of different operators and the adoption of AOS method. © 2021, Springer Nature Switzerland AG.

关键词： Multiobjective optimization

Front-end Replication Dynamic Window (FRDW) for Online Motor imagery Classification

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Chen, Xinru An, Jiayu Wu, Huanyu Li, Siyang Liu, Bin Wu, Dongrui The Ministry of Education Key Laboratory of Image Processing and Intelligent Control School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China The Shenzhen Huazhong University of Science and Technology Research Institute Shenzhen China Beijing Fenghuo Wanjia Technology Co. Ltd. Beijing100026 China

Motor imagery (MI) is a classical paradigm in electroencephalogram (EEG) based brain-computer interfaces (BCIs). Online accurate and fast decoding is very important to its successful applications. This paper proposes a simple yet effective front-end replication dynamic window (FRDW) algorithm for this purpose. Dynamic windows enable the classification based on a test EEG trial shorter than those used in training, improving the decision speed;front-end replication fills a short test EEG trial to the length used in training, improving the classification accuracy. Within-subject and cross-subject online MI classification experiments on three public datasets, with three different classifiers and three different data augmentation approaches, demonstrated that FRDW can significantly increase the information transfer rate in MI decoding. Additionally, FR can also be used in training data augmentation. FRDW helped win national champion of the China BCI Competition in 2022. © 2024, CC BY.

关键词： Brain computer interface

Manifold Learning Inspired Mating Restriction for Evolutionary Constrained Multiobjective Optimization 11th

学校读者我要写书评

暂无评论

Manifold Learning Inspired Mating Restriction for Evolutiona...

11th International Conference on Evolutionary Multi-Criterion Optimization, EMO 2021

作者： Li, Lianghao He, Cheng Cheng, Ran Pan, Linqiang Key Laboratory of Image Information Processing and Intelligent Control of Education Ministry of China School of Artificial Intelligence and Automation Huazhong University of Science and Technology Wuhan430074 China Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation Department of Computer Science and Engineering Southern University of Science and Technology Shenzhen518055 China

ISBN: (纸本)9783030720612

Mating restriction strategies are capable of restricting the distribution of parent solutions for effective offspring generation in evolutionary algorithms (EAs). Studies have shown the importance of these strategies in improving the performance of EAs for multiobjective optimization. Our previous study proposed a specific manifold learning inspired mating restriction (MLMR) strategy. It has shown promising capability of solving multiobjective optimization problems (MOPs) with complicated Pareto set shapes. However, the effect of mating restriction strategies in solving constrained MOPs is yet to be well studied. Here, we investigate the effectiveness of MLMR for solving constrained MOPs. The MLMR strategy is embedded into some representative multiobjective EAs and tested on various benchmark constrained MOPs. Experimental results indicate the encouraging performance of MLMR in constrained multiobjective optimization. © 2021, Springer Nature Switzerland AG.

关键词： Multiobjective optimization