检索结果-内蒙古大学图书馆

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Jianhua Dong Shengrong Zhao Hu Liang Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China

Masked Language Modeling (MLM) and Image-Text Matching (ITM) are always used in fusion encoder to learn the joint representation of images and text. In existing methods, the masking strategy of MLM leads to the neglect of image details during the modeling process. Meanwhile, the sampling strategy of ITM struggles to consistently select high-difficulty hard negative instances, reducing the effectiveness of constraints. This leads to challenges in aligning fine-grained information in cross-modal retrieval. In response to this challenge, a fine-grained information alignment-based visual language model (FAM) is proposed in this paper. On one hand, the attribute-based masking strategy is employed in MLM, helping the model focus on the details of objects in images during modeling. On the other hand, the robust hard negative sample generation strategy provides challenging negative samples for ITM by altering the relationships between objects. This enables the model to align relationships between objects in different modalities and thus calibrates cross-modal retrieval. Extensive experiments demonstrate the effectiveness of the model in cross-modal retrieval tasks.

关键词：

来源：评论

学校读者我要写书评

暂无评论

TransHFC: Joints Hypergraph Filtering Convolution and Transformer Framework for Temporal Forgery Localization

引用

IEEE Transactions on Circuits and Systems for Video technology 2025年

作者： Huang, Jiahao Yuan, Xiaochen Lam, Chan-Tong Im, Sio-Kei Lei, Fangyuan Bi, Xiuli Macao Polytechnic University Faculty of Applied Sciences Macao999078 China Macao Polytechnic University Macau999078 China Guangdong Polytechnic Normal University Guangdong Provincial Key Laboratory of Intellectual Property and Big Data Guangzhou510665 China Chongqing University of Posts and Telecommunications Department of Computer Science and Technology Chongqing400065 China

The authenticity of audio-visual content is being challenged by advanced multimedia editing technologies inspired by Artificial Intelligence-Generated Content (AIGC). Temporal forgery localization aims to detect suspicious contents by locating forged segments. So far, most of the existing methods are based on Convolutional Neural Networks (CNNs) or Transformers, yet neither of them has fully considered the complex relationships within forged audio-visual content. To address this issue, in this paper, we propose a novel method, named TransHFC, which innovatively introduces hypergraphs to model group relationships among segments while considering point-to-point relationships through Transformers. Through its dual hypergraph filtering convolution branch, TransHFC captures both temporal and spatial level group relationships, enhancing the representation of forged segment features. Furthermore, we propose a new hypergraph filtering convolution Auto-Encoder that uses a multi-frequency filter bank for adaptive signal capture. This design compensates for the limitation of a single hypergraph filter. Our extensive experiments on Lav-DF, TVIL, Psynd, and HAD datasets demonstrate that TransHFC achieves state-of-the-art performance. © 1991-2012 IEEE.

关键词： Convolutional neural networks

来源：评论

学校读者我要写书评

暂无评论

Semantic and Emotional Dual Channel for Emotion Recognition in Conversation

引用

IEEE Transactions on Affective Computing 2025年

作者： Yang, Zhenyu Zhang, Zhibo Cheng, Yuhu Zhang, Tong Wang, Xuesong Jinan250353 China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Jinan250353 China Shandong Fundamental Research Center for Computer Science Shandong Provincial Key Laboratory of Industrial Network and Information System Security Jinan250353 China China University of Mining and Technology Engineering Research Center of Intelligent Control for Underground Space Ministry of Education Xuzhou Key Laboratory of Artificial Intelligence and Big Data School of Information and Control Engineering Xuzhou221116 China South China University of Technology Guangdong Provincial Key Laboratory of Computational Intelligence and Cyberspace Information School of Computer Science and Engineering Guangzhou510006 China Pazhou Lab Guangzhou510335 China Engineering Research Center Ministry of Education on Health Intelligent Perception and Paralleled Digital-Human Guangzhou China

Emotion recognition in conversation (ERC) aims at accurately identifying emotional states expressed in conversational content. Existing ERC methods, although relying on semantic understanding, often encounter challenges when confronted with incomplete or misleading semantic information. In addition, when dealing with the interaction between emotional and semantic information, existing methods are often difficult to effectively distinguish the complex relationship between the two, which affects the accuracy of emotion recognition. To address the problems of semantic misdirection and emotional cross-talk encountered by traditional models when confronted with complex conversational data, we propose a semantic and emotional dual channel (SEDC) strategy for emotion recognition in conversations to process emotional and semantic information independently. Under this strategy, emotion information provides an auxiliary recognition function when the semantics are unclear or lacking, enhancing the accuracy of the model. Our model consists of two modules: the emotion processing module accurately captures the emotional features of each utterance through contrastive learning, and then constructs a dialogue emotion propagation map to simulate the emotional information conveyed in the dialogue;the semantic processing module combines an external knowledge base to enhance the semantic expression of the dialogue through knowledge enhancement strategies. This divide-and-conquer approach allows us to more deeply analyze the emotional and semantic dimensions of complex dialogues. Experimental results on the IEMOCAP, EmoryNLP, MELD, and DailyDialog datasets show that our approach significantly outperforms existing techniques and effectively improves the accuracy of dialogue emotion recognition. Our code is available at https://***/r/SEDC-FCF1. © 2010-2012 IEEE.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

Analysis of solution to an elliptic free boundary value problem equipped with a ‘bad’ data

arXiv

引用

arXiv 2024年

作者： Choudhuri, Debajyoti Zeng, Shengda School of Basic Sciences Indian Institute of Technology Bhubaneswar Khordha Odisha 752050 India Center for Applied Mathematics of Guangxi Guangxi Colleges Universities Key Laboratory of Complex System Optimization and Big Data Processing Yulin Normal University Guangxi Yulin537000 China

关键词： Boundary value problems

来源：评论

学校读者我要写书评

暂无评论

Multimodal Dialogue Emotion Recognition Based on Label Optimization and Coarse-Grained Assisted Fine-Grained

Multimodal Dialogue Emotion Recognition Based on Label Optim...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Zhibo Zhang Zhenyu Yang Yan Huang Baojie Xu Wenyue Hu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center (National Supercomputer Center in Jinan) Qilu University of Technology (Shandong Academy of Sciences) China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) China Shandong Provincial Key Laboratory of Industrial Network and Information System Security Shandong Fundamental Research Center for Computer Science China

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Multimodal dialogue emotion recognition integrates data from multiple modalities to accurately identify emotional states in conversations. However, differences in expression and information density across modalities complicate the fusion of features. Traditional methods may introduce redundant information from other utterances, reducing the accuracy of emotion recognition. Existing one-hot labels often fail to capture the full range of emotional expressions, leading to biased results. To address these issues, we propose a model that fuses different modalities within the same utterance to avoid redundancy. It employs a progressive classification process, refining emotion recognition from coarse to fine granularity. Additionally, we use emotion polarity probabilities as weights for fine-grained classification and introduce a multimodal information-rich label that considers both the data and their interactions. Experiments on IEMOCAP and MELD datasets demonstrate the model’s effectiveness, significantly improving dialog emotion recognition accuracy. Our code is available at https://***/r/LOCG-188E.

关键词： Emotion recognition Accuracy Fuses Refining Termination of employment Speech recognition Signal processing Speech processing Optimization Faces

来源：评论

学校读者我要写书评

暂无评论

CAFI: News Recommendation with Candidate Perception of Fine-Grained Interaction Information

CAFI: News Recommendation with Candidate Perception of Fine-...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Yiwen Li Zhenyu Yang Xiaoyang Li Zhijun Li Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

The most critical task in personalized news recommendation is to perform exact matching between candidate news and users’ interests. Existing news recommendation methods usually model users’ interests from historical clicked news items without considering candidate news, which makes it difficult to precisely match candidate news with users’ interests. Moreover, it is challenging to distinguish similar news when forming a vector representation. Simply adding candidate news to the user interest modeling process without considering word-level information does not provide sufficient discrimination for recommending appropriate news. In this paper, we propose a news recommendation model with candidate-aware fine-grained interaction information (CAFI). In our approach, we propose a fine-grained interaction module that matches candidate news items and text fragments of each historical news item at each semantic granularity to achieve interaction between the two at the word level and help similar historical news form more specific and accurate representations. In addition, our proposed gated self-attention mechanism utilizes the candidate news features as channel moderation gates to implement the process of filtering out information that is irrelevant to the candidate news for learning user interest representations, thereby better matching the candidate news to specific user interests. Experiments conducted on the large real-world Microsoft News dataset (MIND) show that our model significantly outperforms the previously developed models in terms of all metrics. Our code is published at the following URL: https://***/liyiweneven/CAFI.

关键词： Uniform resource locators Measurement Codes Filtering Federated learning Semantics Focusing

来源：评论

学校读者我要写书评

暂无评论

LESaET: Low-Dimensional Embedding Method for Link Prediction Combining Self-Attention and Enhanced-TuckER

LESaET: Low-Dimensional Embedding Method for Link Prediction...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Lichao Ding Jing Zhao Kai Lu Zenghao Hao Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

Knowledge graphs (KGs) provide a structured representation of the real world through entity-relation triples. However, current KGs are often incomplete, typically containing only a small fraction of all possible facts. This involves inferring missing content from existing information, a task known as link prediction. Existing methods in the field of link prediction struggle with controlling the dimensionality of embedding vectors or suffer from overly complex models. In order to tackle these challenges, we introduce a method in this paper, named Low-Dimensional Embedding Method for Link Prediction Combining Self-Attention and Enhanced-TuckER (LESaET). LESaET leverages both self-attention mechanisms and tensor factorization to learn expressive contextual-enhanced representations of KGs. Specifically, LESaET employs the multi-head self-attention mechanism of Transformer as an encoder to capture the mutual information between entities and relationships, and utilizes Enhanced-TuckER as a decoder, ultimately achieving expressive low-dimensional embeddings for link prediction tasks. LESaET demonstrates competitive performance compared to advanced methods on standard datasets.

关键词： Tensors Stacking Knowledge graphs Predictive models Transformers Vectors Decoding Standards Mutual information Periodic structures

来源：评论

学校读者我要写书评

暂无评论

Topic-based Multi-layer Knowledge Filtering for Emotion Recognition in Conversation

Topic-based Multi-layer Knowledge Filtering for Emotion Reco...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Xiaoyang Li Zhenyu Yang Yiwen Li Zhijun Li Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

Emotion recognition in conversation (ERC) is a prominent research topic in natural language processing, widely applicable in various scenarios. However, accessing external commonsense knowledge and related dialogue topics, along with the complexity of fusing utterances, presents significant challenges. In this paper, we introduce a Topic-based Multilayer Knowledge Filtering (TMKF) model to enhance dialog emotion recognition accuracy. TMKF acquires commonsense knowledge for each utterance and employs two Variational Autoencoder (VAE) modules to extract global and speaker-level dialogue topics. We utilize Global Knowledge Filtering (GKF) and Local Knowledge Filtering (LKF) to obtain topic-specific knowledge representations after filtering commonsense information through global and local topic hierarchies. Subsequently, we leverage relational graphs to convolve commonsense knowledge with utterances, resulting in knowledge-constrained utterance representations for classification. Our proposed model is evaluated through extensive experiments on four widely used benchmark datasets for conversational emotion recognition. The results underscore the effectiveness of TMKF, which significantly outperforms other methods in standard metric evaluations.

关键词： Measurement Emotion recognition Filtering Convolution Oral communication Benchmark testing Nonhomogeneous media

来源：评论

学校读者我要写书评

暂无评论

HGTA: News Recommendation Based on Hierarchical Granular Semantic Embeddings and Threshold Attention

HGTA: News Recommendation Based on Hierarchical Granular Sem...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Yiwen Li Zhenyu Yang Zhijun Li Xiaoyang Li Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

Personalized news recommendation helps users find interesting content among much news information. Most existing news recommendation techniques densely interact a user’s historical clicked news with candidate news to capture their reading interest. However, during this process, even if certain historical clicked news is weakly correlated with the candidate news, the model still interacts with it, generating more noise information when constructing user interests. Simultaneously, the news representation learning process using neural networks is a fine-grained to coarse-grained learning process; i.e., as the network deepens, the fine-grained original news information is easily lost. Therefore, to solve the above problems, this paper proposes a news recommendation model based on hierarchical granular semantic embeddings and threshold attention (HGTA). In HGTA, we propose a threshold attention module to filter unimportant historical clicked news by setting an attention score threshold, i.e., interacting only with historical clicked news that is strongly correlated with the candidate news when capturing user interests. Thus, the model attention is focused, and the noisy interaction information is reduced. Furthermore, when training the neural network, to prevent the loss of fine-grained information, we design a hierarchical granular information extraction module to capture both coarse- and fine-grained news features to better enrich the news semantics. Experiments conducted on the large real-world Microsoft News dataset (MIND) show that our model achieves highly competitive results in terms of popular metrics. Our code is published at the following URL: https://***/liyiweneven/HGTA.

关键词： Uniform resource locators Training Representation learning Federated learning Semantics Neural networks Noise

来源：评论

学校读者我要写书评

暂无评论

TSFE: Research on Transformer and Feature Enhancement Methods for Image-Text Retrieval

TSFE: Research on Transformer and Feature Enhancement Method...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Jinxiao Yang Xingang Wang Qingao Wang Key Laboratory of Computing Power Network and Information Security Ministry of EducationShandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

In recent years, cross-modal retrieval has a wide range of applications in fields such as information retrieval and multimedia processing, where the key is to find relevant data in another modality through one modal query. In cross-modal graphic retrieval, mutual attention mechanisms are commonly used to interact image and text features. However, this interaction mechanism makes it difficult to extract separate visual and textual features for subsequent indexing steps, especially in large-scale retrieval tasks. Furthermore, in image representation, non-semantic information in image features can lead to inaccuracies in the alignment of image and text features. Therefore this paper proposes a Transformer and Feature Enhancement Method (TSFE) for Image-Text Retrieval. The method better fuses the underlying features and the higher level features by using a hierarchical Transformer coding structure on two separate branches, image and text, to proofread and localise the final output features. The Feature Enhanced Attention (FEA) module is designed in order to infer non-semantic information in the image and enhance the features of salient regions. Channel-space attention and max pooling is introduced on top of Transformer encoder self-attention to filter redundant and interfering information from channel and spatial dimensions. Experiments on Flickr30k dataset and MS-COCO dataset in this paper show improved performance in cross-modal retrieval, thus validating the effectiveness and sophistication of the proposed method.

关键词： Visualization Semantics Pipelines Noise Image representation Transformers Feature extraction

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：