检索结果-内蒙古大学图书馆

Causal Attention Transformer for Video Text Retrieval

IET Image Processing 2025年第1期19卷

作者： Lan, Hua Lv, Chaohui School of Information and Communication Engineering Communication University of China Beijing China Key Laboratory of Acoustic Visual Technology and Intelligent Control System Ministry of Culture and Tourism Beijing China

In the metaverse, video text retrieval is an urgent and challenging need for users in social entertainment. The current attention-based video text retrieval models have not fully explored the interaction between video and text, and only brute force feature embedding. Moreover, Due to the unsupervised nature of attention weight training, existing models have weak generalization performance for dataset bias. Essentially, the model learns that false relevant information in the data is caused by confounding factors. Therefore, this article proposes a video text retrieval method based on causal attention transformer. Assuming that the confounding factors affecting the performance of video text retrieval all come from the dataset, a structural causal model that conforms to the video text retrieval task is constructed, and the impact of confounding effects during data training is reduced by adjusting the front door. In addition, we use causal attention transformer to construct a causal inference network to extract causal features between video text pairs, and replace the similarity statistical probability with causal probability in the video text retrieval framework. Experiments are conducted on the MSR-VTT, MSVD, and LSMDC datasets, which proves the effectiveness of the retrieval model proposed in this paper. © 2025 The Author(s). IET Image Processing published by John Wiley & Sons Ltd on behalf of The Institution of Engineering and technology.

关键词： Interactive computer graphics

来源：评论

学校读者我要写书评

暂无评论

An Improved Dual Neural Network Method Based on Levy Flight for Multi-Robot Cooperative Area Coverage Search in 3D Unknown Environments

引用

IEEE Transactions on Cognitive and Developmental Systems 2025年

作者： Zhang, Fangfang Wang, Yongqi Wang, Wenhao Xin, Jianbin Peng, Jinzhu Wang, Yaonan Zhengzhou University School of Electrical and Information Engineering Zhengzhou450001 China State Key Laboratory of Intelligent Agricultural Power Equipment Luoyang471039 China National Engineering Laboratory of Robot Visual Perception and Control Technology School of Robotics Hunan University Changsha410082 China

The research on multi-robot collaborative search in unknown 3D environments, based on bio-inspired neural networks, holds significant value and ***, challenges arise in 3D environments, including excessive turning and vertical movement, as well as the potential for collisions between robots. In response, we propose an improved Glasius Bio-Inspired Neural Network(GBNN) that mitigates decision conflicts among robots and considers the impact of turning and vertical movement on robot decision-making. Furthermore, to address the issue of robots getting trapped in local deadlocks during the search process, we present a dual neural network algorithm based on Levy flights. In the method Dual Glasius Bio-Inspired Neural Network based on Levy Flight(LF-DUAL-GBNN) proposed in this paper, robots obtain random target points through Levy flights and are then guided by a dual neural network to navigate to the vicinity of the target points, thus breaking free from local deadlock states. Finally, we conducted simulation experiments to validate the algorithm's effectiveness. © 2016 IEEE.

关键词： Microrobots

来源：评论

学校读者我要写书评

暂无评论

Learning to Learn Transferable Generative Attack for Person Re-Identification

引用

IEEE Transactions on Image Processing 2025年 PP卷 PP页

作者： Bian, Yuan Liu, Min Wang, Xueping Ma, Yunfeng Wang, Yaonan Hunan University National Engineering Research Center of Robot Visual Perception and Control Technology College of Electrical and Information Engineering Hunan Changsha China Hunan Normal University Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing College of Information Science and Engineering Hunan Changsha China

Deep learning-based person re-identification (reid) models are widely employed in surveillance systems and inevitably inherit the vulnerability of deep networks to adversarial attacks. Existing attacks merely consider cross-dataset and cross-model transferability, ignoring the cross-test capability to perturb models trained in different domains. To powerfully examine the robustness of real-world re-id models, the Meta Transferable Generative Attack (MTGA) method is proposed, which adopts meta-learning optimization to promote the generative attacker producing highly transferable adversarial examples by learning comprehensively simulated transfer-based crossmodel&dataset&test black-box meta attack tasks. Specifically, cross-model&dataset black-box attack tasks are first mimicked by selecting different re-id models and datasets for meta-train and meta-test attack processes. As different models may focus on different feature regions, the Perturbation Random Erasing module is further devised to prevent the attacker from learning to only corrupt model-specific features. To boost the attacker learning to possess cross-test transferability, the Normalization Mix strategy is introduced to imitate diverse feature embedding spaces by mixing multi-domain statistics of target models. Extensive experiments show the superiority of MTGA, especially in cross-model&dataset and cross-model&dataset&test attacks, our MTGA outperforms the SOTA methods by 20.0% and 11.3% on mean mAP drop rate, respectively. © 1992-2012 IEEE.

关键词： Generative adversarial networks

来源：评论

学校读者我要写书评

暂无评论

Effects of disparity distribution on visual comfort for multiple objects of stereoscopic images

引用

High technology Letters 2019年第1期25卷 42-47页

作者： Su Zhibin Li Dongrui Zou Fangju Ren Hui Key Laboratory of Acoustic Visual Technology and Intelligent Control System & China Beijing Key Laboratory of Modern Entertainment Technology Communication University of China

With the development of stereoscopic technology, more attention is attracted on the stereoscopic three-dimensional(S3 D) content and service, and researches on images and videos have emerged in large numbers. This paper focuses mainly on visual comfort affected by characteristics of disparity for multiple objects. To find the relationship between disparity distribution and visual comfort perception, several subject evaluation experiments are done. The study contains two spatial distribution types of disparity: 1) only one of the foreground objects has zero disparity; 2) one of the foreground objects has positive disparity, while the other one has negative disparity. The experimental results and relative regression analysis provide appropriate relationship between disparity distribution and visual comfort for both conditions, which is significant to meet the applicant field in S3 D content acquisition, display adjustment and quality evaluation.

关键词： disparity distribution disparity magnitude stereoscopic images visual comfort regression analyses

来源：评论

学校读者我要写书评

暂无评论

Resilient Formation control Based on Watermarks for Networked Quadrotors under Deception Attacks

引用

IEEE Transactions on Vehicular technology 2025年

作者： Zhan, Weiwei Miao, Zhiqiang Zeng, Jianxin Chen, Yanjie Wu, Zheng-Guang He, Wei Wang, Yaonan Hunan University College of Electrical and Information Engineering Changsha410082 China Fuzhou University School of Mechanical Engineering and Automation Fuzhou350108 China National Engineering Research Center of Robot Visual Perception and Control Technology Changsha410082 China Zhejiang University Institute of Cyber-Systems and Control Hangzhou310027 China University of Science and Technology Beijing Key Laboratory of Intelligent Bionic Unmanned Systems Ministry of Education School of Intelligence Science and Technology Institute of Artificial Intelligence Beijing100083 China

This article addresses the problem of formation control of networked UAVs under deception attacks. A lightweight resilient formation control framework based on watermarks is proposed to achieve the desired formation configuration without extra monitoring attack status. Since deception attacks are covert, the shared information is watermarked before transmission to establish the protocol among networked UAVs. To facilitate the resilient formation controller design, a decoder is first developed to decipher the inverse transformation of deception attacks, where the watermark is the criterion for approximating the inverse transformation. The Gauss error function is introduced to eliminate some unrealistic input commands under deception attacks, obtaining the predefined input performance. Then, a resilient formation controller is developed to guarantee the global boundedness of all signals within the inner-loop and outerloop system, while the formation error converges to a small neighborhood of zero by solving the linear matrix inequality. Two challenging deception attack examples in simulations and experiments are conducted to verify the effectiveness and performance of the proposed resilient formation control framework. © 1967-2012 IEEE.

关键词： Inverse transforms

来源：评论

学校读者我要写书评

暂无评论

Tackling Real-world Complexity: Hierarchical Modeling and Dynamic Prompting for Multimodal Long Document Classification

引用

IEEE Transactions on Circuits and Systems for Video technology 2025年

作者： Liu, Tengfei Hu, Yongli Li, Mingjie Yi, Junfei Chang, Xiaojun Gao, Junbin Yin, Baocai Beijing University of Technology Beijing Key Laboratory of Multimedia and Intelligent Software Technology Beijing Institute of Artificial Intelligence School of Information Science and Technology Beijing100124 China Stanford University Department of Radiation Oncology StanfordCA94305 United States Hunan University National Engineering Laboratory of Robot Visual Perception and Control Technology College of Electrical and Information Engineering Hunan Changsha410082 China University of Technology Sydney ReLER Laboratory Australian Artificial Intelligence Institute Faculty of Engineering and Information Technology UltimoNSW2007 Australia The University of Sydney Business School The University of Sydney Discipline of Business Analytics CamperdownNSW2006 Australia

With the rapid growth of internet content, multimodal long document data has become increasingly prominent, drawing significant attention from researchers. However, most existing methods primarily focus on scenarios where all modalities are present, often overlooking more challenging and realistic cases involving missing image modality. To address this limitation, we propose a robust multimodal long document classification (MLDC) framework that integrates hierarchical modeling and dynamic prompting to handle complex multimodal long document data. Our approach begins by leveraging hierarchical modeling combined with an Adaptive Correlation Multimodal Transformer (ACMT) to effectively capture relationships between text and images at both section and sentence levels. We also introduce a Dynamic Prompt Generation (DPG) module at both levels to enhance the model's robustness in handling missing image data. By evaluating sample uncertainty, the DPG module dynamically adjusts both the number of prompts and the prompts themselves, allowing the model to better adapt to the varying needs of different samples. Finally, a Hierarchical Heterogeneous Graph (HHG) is introduced to enhance feature interactions across levels, further improving the coherence and accuracy of the model. Extensive experiments on four multi-modal long document datasets demonstrate that our model shows superior performance compared to existing state-of-the-art MLDC classification methods in various conditions. © 1991-2012 IEEE.

关键词： dynamic prompt generation hierarchical heterogeneous graph Multimodal long document classification

来源：评论

学校读者我要写书评

暂无评论

Salient Object Detection in Traffic Scene through the TSOD10K Dataset

arXiv

引用

arXiv 2025年

作者： Qiu, Yu Sun, Yuhang Mei, Jie Xiao, Lin Xu, Jing College of Information Science and Engineering Hunan Normal University Changsha410081 China National Key Laboratory of Intelligent Tracking and Forecasting for Infectious Diseases College of Artificial Intelligence Nankai University Tianjin300350 China National Engineering Research Center of Robot Visual Perception and Control Technology School of Robotics Hunan University Changsha410082 China

Traffic Salient Object Detection (TSOD) aims to segment the objects critical to driving safety by combining semantic (e.g., collision risks) and visual saliency. Unlike SOD in natural scene images (NSI-SOD), which prioritizes visually distinctive regions, TSOD emphasizes the objects that demand immediate driver attention due to their semantic impact, even with low visual contrast. This dual criterion, i.e., bridging perception and contextual risk, re-defines saliency for autonomous and assisted driving systems. To address the lack of task-specific benchmarks, we collect the first large-scale TSOD dataset with pixel-wise saliency annotations, named TSOD10K. TSOD10K covers the diverse object categories in various real-world traffic scenes under various challenging weather/illumination variations (e.g., fog, snowstorms, low-contrast, and low-light). Methodologically, we propose a Mamba-based TSOD model, termed Tramba. Considering the challenge of distinguishing inconspicuous visual information from complex traffic backgrounds, Tramba introduces a novel Dual-Frequency visual State Space module equipped with shifted window partitioning and dilated scanning to enhance the perception of fine details and global structure by hierarchically decomposing high/low-frequency components. To emphasize critical regions in traffic scenes, we propose a traffic-oriented Helix 2D-Selective-Scan (Helix-SS2D) mechanism that injects driving attention priors while effectively capturing global multi-direction spatial dependencies. We establish a comprehensive benchmark by evaluating Tramba and 22 existing NSI-SOD models on TSOD10K, demonstrating Tramba’s superiority. Our research establishes the first foundation for safety-aware saliency analysis in intelligent transportation systems. Copyright © 2025, The Authors. All rights reserved.

关键词： Risk perception

来源：评论

学校读者我要写书评

暂无评论

Subjective Evaluation and Objective Analysis of Timbre Fusion of Chinese and Western Musical Instruments

Subjective Evaluation and Objective Analysis of Timbre Fusio...

引用

2021 International Conference on Culture-Oriented Science and technology, ICCST 2021

作者： Liu, Jingyu Ran, Can Chen, Yuqu Xiang, Huiling Lin, Jiayu Huang, Yongzhan Jiang, Wei Ministry of Culture and Tourism Key Laboratory of Acoustic Visual Technology and Intelligent Control System China

ISBN: (纸本)9781665442541

Timbre fusion is the theoretical basis for the study of musical instrument acoustics and orchestration acoustics. At present, most of the research on timbre fusion is carried out on Western musical instruments. There are very few studies on the timbre fusion of Chinese musical instruments. The studies done are mainly studied from a qualitative perspective. Quantitative research on the timbre fusion of Chinese musical instruments will provide important theoretical support for the symphony research of the Chinese orchestra. Taking Chinese and Western musical instruments as research object, this paper constructs a Chinese and Western musical instrument fusion timbre database;a subjective experiment on timbre fusion is designed and implemented based on this database;45-dimensional objective acoustic parameters are extracted from the database. We use multiple linear regression, random forest, and multi-layer perceptron to correlate subjective and objective data and eventually construct a fusion model of Chinese and Western musical instruments. The accuracy of the models is tested, which shows that the model can predict the fusion of Chinese and Western musical instruments well. This study also found that the contribution rate of each objective acoustic parameter to fusion is different, and there are also differences between the timbre fusion models of Chinese musical instruments and Western musical instruments. © 2021 IEEE.

关键词： Decision trees

来源：评论

学校读者我要写书评

暂无评论

MovieEmotion-IMG: An Emotion Distribution Dataset of Movie Scene Images

MovieEmotion-IMG: An Emotion Distribution Dataset of Movie S...

引用

2021 International Conference on Culture-Oriented Science and technology, ICCST 2021

作者： Zhang, Jingjing Lin, Chen Wang, Chunxiao Dong, Yicong Jiang, Wei Ministry of Culture and Tourism Key Laboratory of Acoustic Visual Technology and Intelligent Control System China

ISBN: (纸本)9781665442541

One of the biggest challenges in sentiment analysis is to predict the complex feelings that humans evoke when viewing images. Due to the limitation of the quality and quantity of the dataset, the current learning-based algorithm mainly analyzes a single dominant emotion. Based on the above, this paper introduces an emotion distribution dataset of movie scene images with rich emotional semantics and professional aesthetic design, called MovieEmotion-IMG. Firstly nine labels, including eight emotional words and a 'neutrality' label, were identified, and a set of emotional evaluation rules were designed. Then, the emotion distribution annotation experiment was carried out on 17140 movie images, and an emotion annotation system was developed to assist the annotation work. Finally, two reliability test methods were designed based on the external reliability test method to verify the reliability of the results and ensure the availability of the dataset. This is the first large-scale emotion dataset of movie scene images and annotated distributed emotions to our knowledge. © 2021 IEEE.

关键词： Sentiment analysis

来源：评论

学校读者我要写书评

暂无评论

Risk Assessment of Stage Machinery Based on Entropy Weight and Fuzzy Inference Method

Risk Assessment of Stage Machinery Based on Entropy Weight a...

引用

2023 International Conference on Culture-Oriented Science and technology, CoST 2023

作者： Wang, Huiqin Yang, Qingqing Li, Zhen Wang, Huiqi Ministry of Culture and Tourism Key Laboratory of Acoustic Visual Technology and Intelligent Control System Beijing China

ISBN: (纸本)9798350357998

It is of great significance to find out the hidden hazards of the stage machinery in advance and formulate the corresponding protective measures to improve the safety of the stage performance. A comprehensive method that integrates entropy weights and the fuzzy inference is proposed. Firstly, the risk factors are identified through Failure Modes and Effects Analysis (FMEA) method, with the information obtained by field survey and research. Then, the entropy weight method and Fault Tree Analysis (FTA) methods are adopted to analyze the risk factors so as to obtain the probability of the hazardous events. Lastly, the risk level of different event is obtained by the fuzzy inference method. The simulation result proves that the model is reasonable, objective, and feasible. © 2023 IEEE.

关键词： Fuzzy inference

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：