检索结果-内蒙古大学图书馆

Multi-modal sentiment recognition with residual gating network and emotion intensity attention

Neural Networks 2025年 188卷 107483页

作者： Wang, Yadi Guo, Xiaoding Hou, Xianhong Miao, Zhijun Yang, Xiaojin Guo, Jinkai School of Computer and Information Engineering Henan University Kaifeng475004 China Henan Key Laboratory of Big Data Analysis and Processing Kaifeng475004 China

Multimodal emotion recognition focuses on the prediction of emotions using text, visual and acoustic modalities, and some results have been generated in this field. Previous approaches fall short in two aspects, one is the processing of complementary information among modalities, the other is how to avoid the long-term dependency and select the most important joint modal features. In this paper, we propose a new multimodal emotion recognition framework MSRG, which consists of feature extraction (FE), emotional intensity attention (EIA), time-step level fusion (TLF), utterance level fusion (ULF), and sentiment inference module (SIM). EIA is divided into adaptive multimodal linear pooling (AMLP) and joint cross-attention fusion (JCAF), where AMLP adopts the adaptive strategy of multimodal fusion to dynamically calculate the adaptive coefficients of three modalities, then performs the pooling operation to obtain joint modal features. JCAF calculates the attention weights and attention features of each modality based on cross-correlation between individual and joint features. TLF performs feature alignment fusion at the time-step level, then uses the residual gating network (RGN) to process the time-step level fused sequences. The obtained time-step level fused features are then input into two fully connected layers and an activation layer to obtain the time-step level emotion intensity. ULF fuses the three modalities’ utterance level representations by concatenating them and then inputs the obtained utterance level fused features into a fully connected layer to obtain the utterance level emotion intensity. Finally, both the time-step level emotion intensity and the utterance level emotion intensity are input into SIM to obtain the final emotion prediction results. Experiments demonstrate that MSRG achieves better prediction performance on CMU-MOSI and CMU-MOSEI datasets. © 2025 Elsevier Ltd

关键词： Emotion Recognition

来源：评论

学校读者我要写书评

暂无评论

Spatial-Temporal Semantic Feature Interaction Network for Semantic Change Detection in Remote Sensing images

引用

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 2025年 18卷 12090-12102页

作者： Zhang, Yuhang Zhang, Wuxia Ding, Songtao Wu, Siyuan Lu, Xiaoqiang Xi'an University of Posts and Telecommunications Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing School of Computer Science and Technology Xi'an710121 China Xi'an University of Technology College of Computer Science and Engineering Shaanxi Xi'an710048 China Fuzhou University College of Physics and Information Engineering Fuzhou350002 China

Semantic Change Detection (SCD) in Remote Sensing images (RSI) aims to identify changes in the type of Land Cover/Land Use (LCLU) corresponding to changed areas in RSI. The "from-to" information of the acquired image has more profound practical significance than Binary Change Detection (BCD). However, most deep learning-based SCD algorithms do not fully exploit the spatial-temporal information of multi-level features, leading to challenges in extracting LCLU features in complex changing scenes. To address these issues, we propose a Spatial-Temporal Semantic Feature Interaction Network (STS-FINet) to improve the performance of SCD in RSI. The proposed STS-FINet comprises a Multi-Scale Feature Extraction Encoder (MS-FEE), a Transformer-based Multi-Level Feature Interaction module (TML-FI), and a Multi-Level Feature Fusion Decoder (ML-FFD). The MS-FEE extracts deep semantic and differential information from the RSI. The TML-FI is designed to mine the spatial-temporal information by extracting long-range dependencies and spatial information from multi-level features to improve spatial perception. Moreover, Mixed Spatial Reasoning Convolution block (MixSrc) is presented to enrich the spatial information by extracting the multi-scale features, thus improving the model's capability to interpret complex changing scenes. Finally, ML-FFD integrates the multi-level features, resulting in the generation of the semantic change map. The effectiveness of the proposed STS-FINet is verified on two high-resolution RSI datasets. Experimental results show that the proposed STS-FINet achieves better change detection performance than SOTA methods. © 2008-2012 IEEE.

关键词： Change detection

来源：评论

学校读者我要写书评

暂无评论

A Lightweight Aerial image Object Detector Based on Mask Information Enhancement

引用

IEEE Transactions on Instrumentation and Measurement 2025年 74卷

作者： Zhou, Liming Zhao, Shuai Liu, Zhehao Zhang, Wanjun Qiao, Baojun Liu, Yang Henan University Henan Key Laboratory of Big Data Analysis and Processing Henan Kaifeng China Henan University School of Computer and Information Engineering Henan Kaifeng China

Object detection in UAV imagery is highly valuable in both military and civilian domains. However, deploying conventional detectors is challenging due to limited computing resources on UAV platforms. Additionally, UAV images often contain densely arranged objects, demanding higher accuracy from detectors. In response to these challenges, we proposed the lightweight aerial object detection method based on mask feature enhancement, named BFDet. First, to enhance the feature extraction capability of the model under limited parameters, we designed the Balanced Channel Attention Layer (BCA Layer). The BCA Layer improves the extraction of high-quality channel information during feature processing. Second, to enhance model performance while minimizing parameters, we designed a feature extraction network utilizing the Efficient Feature Extraction Module (EFEM) and the Downsampling Module (DM) as its backbone. This design reduces the number of parameters while improving the extraction of discriminative features. Third, to enrich the semantic information of features, we proposed a Progressive Space Pyramid Pooling (PSPP) module, obtaining features with rich semantic information to enhance model performance. Finally, to tackle the challenge of detecting densely packed objects, we proposed a Mask Information Enhancement Module (MIEM) to obtain the fine-grained features, enhancing the model's discriminative ability in dense scenes. The proposed BFDet underwent extensive experimentation on both the Vis-Drone and UAVDT datasets. The mAP0.5 and FPS values of BFDet reach 51.4% and 33 respectively on the VisDrone dataset, and the parameter number is only 5.6M. © 1963-2012 IEEE.

关键词： Unmanned aerial vehicles (UAV)

来源：评论

学校读者我要写书评

暂无评论

Advances in Robust Federated Learning: A Survey With Heterogeneity Considerations

引用

IEEE Transactions on Big data 2025年第3期11卷 1548-1567页

作者： Chen, Chuan Liao, Tianchi Deng, Xiaojun Wu, Zihou Huang, Sheng Zheng, Zibin Sun Yat-sen University School of Computer Science and Engineering Guangdong Key Laboratory of Big Data Analysis and Processing Guangzhou510006 China Sun Yat-sen University School of Software Engineering Zhuhai519000 China Sun Yat-sen University School of Computer Science and Engineering Guangzhou510006 China Sun Yat-sen University School of Systems Science and Engineering Guangzhou510006 China Sun Yat-sen University School of Software Engineering Zhuhai Key Laboratory of Trusted Large Language Models Zhuhai519000 China

In the field of heterogeneous federated learning (FL), the key challenge is to efficiently and collaboratively train models across multiple clients with different data distributions, model structures, task objectives, computational capabilities, and communication resources. This diversity leads to significant heterogeneity, which increases the complexity of model training. In this paper, we first outline the basic concepts of heterogeneous FL and summarize the research challenges in FL in terms of five aspects: data, model, task, device and communication. In addition, we explore how existing state-of-the-art approaches cope with the heterogeneity of FL, and categorize and review these approaches at three different levels: data-level, model-level, and architecture-level. Subsequently, the paper extensively discusses privacy-preserving strategies in heterogeneous FL environments. Finally, the paper discusses current open issues and directions for future research, aiming to promote the further development of heterogeneous FL. © 2015 IEEE.

关键词： Federated learning

来源：评论

学校读者我要写书评

暂无评论

DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Model

arXiv

引用

arXiv 2025年

作者： Huang, Junjia Yan, Pengxiang Cai, Jinhang Liu, Jiyang Wang, Zhao Wang, Yitong Wu, Xinglong Li, Guanbin Sun Yat-sen University China ByteDance Intelligent Creation Peng Cheng Laboratory China Guangdong Key Laboratory of Big Data Analysis and Processing China

Text-driven image generation using diffusion models has recently gained significant attention. To enable more flexible image manipulation and editing, recent research has expanded from single image generation to transparent layer generation and multi-layer compositions. However, existing approaches often fail to provide a thorough exploration of multi-layer structures, leading to inconsistent inter-layer interactions, such as occlusion relationships, spatial layout, and shadowing. In this paper, we introduce DreamLayer, a novel framework that enables coherent text-driven generation of multiple image layers, by explicitly modeling the relationship between transparent foreground and background layers. DreamLayer incorporates three key components, i.e., Context-Aware Cross-Attention (CACA) for global-local information exchange, Layer-Shared Self-Attention (LSSA) for establishing robust inter-layer connections, and Information Retained Harmonization (IRH) for refining fusion details at the latent level. By leveraging a coherent full-image context, DreamLayer builds inter-layer connections through attention mechanisms and applies a harmonization step to achieve seamless layer fusion. To facilitate research in multi-layer generation, we construct a high-quality, diverse multi-layer dataset including 400k samples. Extensive experiments and user studies demonstrate that DreamLayer generates more coherent and well-aligned layers, with broad applicability, including latent-space image editing and image-to-layer decomposition. Copyright © 2025, The Authors. All rights reserved.

关键词： image fusion

来源：评论

学校读者我要写书评

暂无评论

DreamFuse: Adaptive image Fusion with Diffusion Transformer

arXiv

引用

arXiv 2025年

作者： Huang, Junjia Yan, Pengxiang Liu, Jiyang Wu, Jie Wang, Zhao Wang, Yitong Lin, Liang Li, Guanbin Sun Yat-sen University China ByteDance Intelligent Creation China Peng Cheng Laboratory China Guangdong Key Laboratory of Big Data Analysis and Processing China

image fusion seeks to seamlessly integrate foreground objects with background scenes, producing realistic and harmonious fused images. Unlike existing methods that directly insert objects into the background, adaptive and interactive fusion remains a challenging yet appealing task. It requires the foreground to adjust or interact with the background context, enabling more coherent integration. To address this, we propose an iterative human-in-the-loop data generation pipeline, which leverages limited initial data with diverse textual prompts to generate fusion datasets across various scenarios and interactions, including placement, holding, wearing, and style transfer. Building on this, we introduce DreamFuse, a novel approach based on the Diffusion Transformer (DiT) model, to generate consistent and harmonious fused images with both foreground and background information. DreamFuse employs a Positional Affine mechanism to inject the size and position of the foreground into the background, enabling effective foreground-background interaction through shared attention. Furthermore, we apply Localized Direct Preference Optimization guided by human feedback to refine DreamFuse, enhancing background consistency and foreground harmony. DreamFuse achieves harmonious fusion while generalizing to text-driven attribute editing of the fused results. Experimental results demonstrate that our method outperforms state-of-the-art approaches across multiple metrics. Copyright © 2025, The Authors. All rights reserved.

关键词： image fusion

来源：评论

学校读者我要写书评

暂无评论

Research on resource scheduling method based on Kubernetes

Research on resource scheduling method based on Kubernetes

引用

IEEE Information Technology and Mechatronics Engineering Conference (ITOEC)

作者： Haoyang Song Liming Zhou Henan Key Laboratory of Big Data Analysis and Processing Henan University Kaifeng China School of Computer and Information Engineering Henan University Kaifeng China

ISBN: (数字)9798331529482

ISBN: (纸本)9798331529499

With the continuous development of cloud computing, the demand for cloud services in all walks of life is increasing. The scale of cloud computing services based on container technology is constantly growing, and Kubernetes has been widely used as a mainstream tool for container orchestration. It supports functions such as automatic deployment and service discovery, dramatically simplifies the container deployment process, and improves the availability and reliability of applications in cloud environments. However, the default scheduling strategy of Kubernetes adopts the greedy idea of first-come-first-served when facing multi-pod tasks, and schedules Pods to working nodes one by one. This scheduling scheme will lead to unbalanced cluster load and low resource utilization. To solve this problem, this paper introduces the selection, crossover, and mutation ideas in genetic algorithms into the artificial fish school algorithm, improves the foraging behavior in the artificial fish school algorithm, and constructs a custom scheduling strategy based on the enhanced artificial fish school algorithm. Experiments have shown that compared with the default scheduling strategy of Kubernetes, the customized scheduling strategy in this paper can effectively improve the load balancing of the cluster and improve the utilization of cluster hardware resources in the scenario of multi-pod scheduling.

关键词： Cloud computing Schedules Clustering algorithms Containers Fish Load management Scheduling Hardware Fish schools Genetic algorithms

来源：评论

学校读者我要写书评

暂无评论

GraphSparseNet: a Novel Method for Large Scale Trafffic Flow Prediction

arXiv

引用

arXiv 2025年

作者： Kong, Weiyang Wu, Kaiqi Zhang, Sen Liu, Yubao Sun Yat-Sen University Guangzhou China Sun Yat-Sen University Guangdong Key Laboratory of Big Data Analysis and Processing Guangzhou China

Traffic flow forecasting is a critical spatio-temporal data mining task with wide-ranging applications in intelligent route planning and dynamic traffic management. Recent advancements in deep learning, particularly through Graph Neural Networks (GNNs), have significantly enhanced the accuracy of these forecasts by capturing complex spatio-temporal dynamics. However, the scalability of GNNs remains a challenge due to their exponential growth in model complexity with increasing nodes in the graph. Existing methods to address this issue, including sparsification, decomposition, and kernel-based approaches, either do not fully resolve the complexity issue or risk compromising predictive accuracy. This paper introduces GraphSparseNet (GSNet), a novel framework designed to improve both the scalability and accuracy of GNN-based traffic forecasting models. GraphSparseNet is comprised of two core modules: the Feature Extractor and the Relational Compressor. These modules operate with linear time and space complexity, thereby reducing the overall computational complexity of the model to a linear scale. Our extensive experiments on multiple real-world datasets demonstrate that GraphSparseNet not only significantly reduces training time by 3.51x compared to state-of-the-art linear models but also maintains high predictive performance. Copyright © 2025, The Authors. All rights reserved.

关键词： Scalability

来源：评论

学校读者我要写书评

暂无评论

Aerial Vision-and-Language Navigation with Grid-based View Selection and Map Construction

arXiv

引用

arXiv 2025年

作者： Zhao, Ganlong Li, Guanbin Pan, Jia Yu, Yizhou The University of Hong Kong Hong Kong Sun Yat-sen University China Guangdong Key Laboratory of Big Data Analysis and Processing China Peng Cheng Laboratory China

Aerial Vision-and-Language Navigation (Aerial VLN) aims to obtain an unmanned aerial vehicle agent to navigate aerial 3D environments following human instruction. Compared to ground-based VLN, aerial VLN requires the agent to decide the next action in both horizontal and vertical directions based on the first-person view observations. Previous methods struggle to perform well due to the longer navigation path, more complicated 3D scenes, and the neglect of the interplay between vertical and horizontal actions. In this paper, we propose a novel grid-based view selection framework that formulates aerial VLN action prediction as a grid-based view selection task, incorporating vertical action prediction in a manner that accounts for the coupling with horizontal actions, thereby enabling effective altitude adjustments. We further introduce a grid-based bird’s eye view map for aerial space to fuse the visual information in the navigation history, provide contextual scene information, and mitigate the impact of obstacles. Finally, a cross-modal transformer is adopted to explicitly align the long navigation history with the instruction. We demonstrate the superiority of our method in extensive experiments. Copyright © 2025, The Authors. All rights reserved.

关键词： Unmanned aerial vehicles (UAV)

来源：评论

学校读者我要写书评

暂无评论

MULTIMODAL QUANTITATIVE LANGUAGE FOR GENERATIVE RECOMMENDATION

arXiv

引用

arXiv 2025年

作者： Zhai, Jianyang Mai, Zi-Feng Wang, Chang-Dong Yang, Feidiao Zheng, Xiawu Li, Hui Tian, Yonghong Sun Yat-sen University China Pengcheng Laboratory China Guangdong Key Laboratory of Big Data Analysis and Processing China Xiamen University China Peking University China

Generative recommendation has emerged as a promising paradigm aiming at directly generating the identifiers of the target candidates. Most existing methods attempt to leverage prior knowledge embedded in Pre-trained Language Models (PLMs) to improve the recommendation performance. However, they often fail to accommodate the differences between the general linguistic knowledge of PLMs and the specific needs of recommendation systems. Moreover, they rarely consider the complementary knowledge between the multimodal information of items, which represents the multi-faceted preferences of users. To facilitate efficient recommendation knowledge transfer, we propose a novel approach called Multimodal Quantitative Language for Generative Recommendation (MQL4GRec). Our key idea is to transform items from different domains and modalities into a unified language, which can serve as a bridge for transferring recommendation knowledge. Specifically, we first introduce quantitative translators to convert the text and image content of items from various domains into a new and concise language, known as quantitative language, with all items sharing the same vocabulary. Then, we design a series of quantitative language generation tasks to enrich quantitative language with semantic information and prior knowledge. Finally, we achieve the transfer of recommendation knowledge from different domains and modalities to the recommendation task through pre-training and fine-tuning. We evaluate the effectiveness of MQL4GRec through extensive experiments and comparisons with existing methods, achieving improvements over the baseline by 11.18%, 14.82%, and 7.95% on the NDCG metric across three different datasets, respectively. 1 © 2025, CC BY.

关键词： Knowledge transfer

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：