检索结果-内蒙古大学图书馆

17th Asian Conference on Computer Vision, ACCV 2024

作者： Song, Jiayan Pan, Renjie Zhou, Jun Yang, Hua Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai200240 China Shanghai Key Lab of Digital Media Processing and Transmission Shanghai200240 China

ISBN: (纸本)9789819609079

Current encoder-decoder methods for image captioning mai-nly consist of an object detection module (two-stage), or rely on big models with large-scale datasets to improve the effectiveness, which leads to increasing computation costs and cannot introduce new external knowledge. In this paper, we propose a novel end-to-end method Multi-grained Retrieval Augmentation Transformer (M-RAT) that innovatively fuses retrieved text derived from a changeable datastore with input visual feature through a Multi-modal Aligned Encoder, and introduce a specialized attention mechanism, Multi-MSA, to exploit both local and global interactions for delicate fine-grained details. Additionally, we enhance the decoder generation ability by employing low-level and high-level fused embeddings. Experiments demonstrate that M-RAT achieves comparable performance to state-of-the-art baselines with remarkable accuracy and details, as well as showing excellent domain adaptability for novel objects. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Decoding

来源：评论

学校读者我要写书评

暂无评论

AMTrans:Auto-Correlation Multi-Head Attention Transformer for Infrared Spectral Deconvolution

引用

清华大学学报自然科学版（英文版） 2025年第3期30卷 1329-1341页

作者： Lei Gao Liyuan Cui Shuwen Chen Lizhen Deng Xiaokang Wang Xiaohong Yan Hu Zhu College of Electronic and Optical Engineering & College of Flexible Electronics(Future Technology) Nanjing University of Posts and TelecommunicationsNanjing 210003China Jiangsu Province Key Lab on Image Processing and Image Communication Nanjing University of Posts and TelecommunicationsNanjing 210003China National Engineering Research Center of Communication and Network Technology Nanjing University of Posts and TelecommunicationsNanjing 210003China School of Computer Science and Technology Hainan UniversityHaikou 570228China

Infrared spectroscopy analysis has found widespread applications in various fields due to advancements in technology and industry *** improve the quality and reliability of infrared spectroscopy signals,deconvolution is a crucial preprocessing *** by the transformer model,we propose an Auto-correlation Multi-head attention Transformer(AMTrans)for infrared spectrum sequence *** auto-correlation attention model improves the scaled dot-product attention in the *** utilizes attention mechanism for feature extraction and implements attention computation using the auto-correlation *** auto-correlation attention model is used to exploit the inherent sequence nature of spectral data and to effectively recovery spectra by capturing auto-correlation patterns in the *** proposed model is trained using supervised learning and demonstrates promising results in infrared spectroscopic *** comparing the experiments with other deconvolution techniques,the experimental results show that the method has excellent deconvolution performance and can effectively recover the texture details of the infrared spectrum.

关键词： spectroscopy spectral deconvolution transformer auto-correlation mechanism

来源：评论

学校读者我要写书评

暂无评论

AGAV-Rater: Adapting Large Multimodal Model for AI-Generated Audio-Visual Quality Assessment

arXiv

引用

arXiv 2025年

作者： Cao, Yuqin Min, Xiongkuo Gao, Yixuan Sun, Wei Zhai, Guangtao Institute of Image Communication and Network Engineering Shanghai Key Laboratory of Digital Media Processing and Transmissions Shanghai Jiao Tong University Shanghai China

Many video-to-audio (VTA) methods have been proposed for dubbing silent AI-generated videos. An efficient quality assessment method for AI-generated audio-visual content (AGAV) is crucial for ensuring audio-visual quality. Existing audio-visual quality assessment methods struggle with unique distortions in AGAVs, such as unrealistic and inconsistent elements. To address this, we introduce AGAVQA, the first large-scale AGAV quality assessment dataset, comprising 3, 382 AGAVs from 16 VTA methods. AGAVQA includes two subsets: AGAVQA-MOS, which provides multi-dimensional scores for audio quality, content consistency, and overall quality, and AGAVQA-Pair, designed for optimal AGAV pair selection. We further propose AGAV-Rater, a LMM-based model that can score AGAVs, as well as audio and music generated from text, across multiple dimensions, and selects the best AGAV generated by VTA methods to present to the user. AGAV-Rater achieves state-of-the-art performance on AGAVQA, Text-to-Audio, and Text-to-Music datasets. Subjective tests also confirm that AGAV-Rater enhances VTA performance and user experience. The project page is available at https://***. Copyright © 2025, The Authors. All rights reserved.

关键词： Subjective testing

来源：评论

学校读者我要写书评

暂无评论

LCIQA: A Lightweight Contrastive-Learning Framework for image Quality Assessment via Cross-Scale Consistency Minimization

引用

IEEE Transactions on Circuits and Systems for Video Technology 2025年

作者： Feng, Chenxi Min, Xiongkuo Ye, Long Yang, Yinghao Communication University of China State Key Laboratory of Media Convergence and Communication Beijing100024 China Shanghai Jiao Tong University Institute of Image Communication and Information Processing Shanghai200240 China Ministry of Education and School of Data Science and Media Intelligence Beijing100024 China

Blind image quality assessment (BIQA), which functions without the need for a reference image, is a challenging yet essential task in various image processing systems and downstream vision applications, ranging from semantic recognition to image enhancement. Traditionally, numerous BIQA models have been developed using supervised learning methodologies, which rely heavily on the availability and quality of ground truth data. To improve the generalization capability and robustness of these models, recent studies have explored the application of contrastive learning, aiming to enhance the quality representation capacity of model backbones through a self-supervised approach. However, the training process for contrastive learning is computationally intensive, posing significant challenges in resource-constrained environments. To mitigate this issue, we propose a Lightweight Contrastive-learning-based IQA (LCIQA) framework, designed to be efficiently trained on a single GPU without relying on ground truth data. This framework maintains a fixed vision backbone and focuses on optimizing the parameters of subsequent IQA heads through contrastive learning. To accommodate a lightweight framework, we incorporate a quality task adapter to eliminate semantic biases introduced by the features extracted from the fixed-parameter backbone. A coarse-to-fine contrastive learning strategy is then employed to train the quality regression module. Extensive experiments demonstrate the superior performance of our model in terms of both accuracy and complexity. In addition, ablation studies validate the effectiveness of each component within the proposed framework. © 1991-2012 IEEE.

关键词： Self-supervised learning

来源：评论

学校读者我要写书评

暂无评论

SSP-IR: Semantic and Structure Priors for Diffusion-based Realistic image Restoration

引用

IEEE Transactions on Circuits and Systems for Video Technology 2025年

作者： Zhang, Yuhong Zhang, Hengsheng Cheng, Zhengxue Xie, Rong Song, Li Zhang, Wenjun Shanghai Jiao Tong University Institute of Image Communication and Network Engineering Shanghai China Shanghai Jiao Tong University MoE Key Lab of Artificial Intelligence AI Institute Shanghai China

Realistic image restoration is a crucial task in computer vision, and diffusion-based models for image restoration have garnered significant attention due to their ability to produce realistic results. Restoration can be seen as a controllable generation conditioning on priors. However, due to the severity of image degradation, existing diffusion-based restoration methods cannot fully exploit priors from low-quality images and still have many challenges in perceptual quality, semantic fidelity, and structure accuracy. Based on the challenges, we introduce a novel image restoration method, SSP-IR. Our approach aims to fully exploit semantic and structure priors from low-quality images to guide the diffusion model in generating semantically faithful and structurally accurate natural restoration results. Specifically, we integrate the visual comprehension capabilities of Multimodal Large Language Models (explicit) and the visual representations of the original image (implicit) to acquire accurate semantic prior. To extract degradation-independent structure prior, we introduce a Processor with RGB and FFT constraints to extract structure prior from the low-quality images, guiding the diffusion model and preventing the generation of unreasonable artifacts. Lastly, we employ a multi-level attention mechanism to integrate the acquired semantic and structure priors. The qualitative and quantitative results demonstrate that our method outperforms other state-of-the-art methods overall on both synthetic and real-world datasets. Our project page is https://***/projects/SSP-IR. © 1991-2012 IEEE.

关键词： image denoising

来源：评论

学校读者我要写书评

暂无评论

IRSEnet: Differentially Private image Generation with Multi-Scale Feature Extraction and Residual Channel Attention 13

IRSEnet: Differentially Private Image Generation with Multi-...

引用

13th International Conference on Intelligent Control and Information processing, ICICIP 2025

作者： Li, Jiahao Wang, Zhongshuai Ghazali, Kamarul Hawari Bin Yan, Suqing Lan, Rushi Sun, Xiyan Luo, Xiaonan Guangxi Key Lab. of Image and Graphic Intelligent Processing Guilin University of Electronic Technology Guilin541004 China Centre for Advanced Industrial Technology University of Malaysia Pahang Al-Sultan Abdullah Pahang Pekan26600 Malaysia Int. Joint Research Lab. of Spatio-temporal Information and Intelligent Location Services Guilin University of Electronic Technology Guilin541004 China

ISBN: (纸本)9798331516147

Privacy-preserving image generation is particularly crucial in fields like healthcare, where data are both sensitive and limited. However, effective privacy preservation often compromises the visual quality and utility of the generated images due to privacy budget constraints. To address this issue, in this paper, We propose a novel network architecture, IRSEnet, which combines multi-scale feature extraction technology and residual channel attention mechanisms, aiming to enhance the visual quality of generated images and improve the performance of downstream classification tasks under differential privacy. The differential privacy mechanism ensures the security of sensitive data during training, while the multi-scale feature extraction module enhances feature extraction capabilities through parallel convolutional layers at multiple scales. Additionally, the channel attention module dynamically adjusts channel weights to focus on the most discriminative features. Experimental results demonstrate that this model significantly improves the utility of generated images and the accuracy of downstream classification tasks while preserving privacy. Future work will explore the application of this approach on larger datasets and across more diverse tasks. © 2025 IEEE.

关键词： Differential privacy

来源：评论

学校读者我要写书评

暂无评论

Mamba-based spatial-spectral fusion network for hyperspectral unmixing

引用

Journal of King Saud University Computer and Information Sciences 2025年第3期37卷 1-24页

作者： Gan, Yuquan Wei, Jingtao Xu, Mengmeng School of Telecommunication and Information Engineering Xi’an University of Posts & Telecommunications Xi’an China Xi’ an Key Laboratory of Image Processing Technology and Applications for Public Security Xi’an University of Posts & Telecommunications Xi’an China Shaanxi Key Laboratory of Information Communication Network and Security Xi’an University of Posts & Telecommunications Xi’an China

Hyperspectral unmixing (HU) is a critical technique in hyperspectral image (HSI) analysis, aimed at decomposing mixed pixels into a set of spectral signatures (endmembers) and their corresponding abundance values. Recently, the Mamba model has gained significant attention for its exceptional performance in natural language processing and has been extended to vision research. With its strong capability for long-range modeling and linear computational complexity, Mamba demonstrates substantial potential in hyperspectral image processing. However, due to the intrinsic requirement of HU tasks for comprehensive integration of spatial and spectral information, challenges remain in effectively leveraging Mamba for hyperspectral representation. To address these issues, we propose a novel Mamba-based spatial-spectral fusion network for hyperspectral unmixing (Mamba-SSFN). This network introduces a fusion mechanism to jointly learn spectral and spatial feature representations, enabling more efficient extraction of critical HSI features. Specifically, in the spatial feature extraction module, we integrate multi-scale analysis with the Mamba module, enabling the capturing of both local and global spatial information. In the spectral feature extraction module, the Mamba module is employed in a grouped manner to process spectral vectors, exploring the correlations among different spectral groups. Finally, an effective fusion mechanism is implemented to integrate spatial and spectral *** results demonstrate that Mamba-SSFN achieves outstanding performance across multiple benchmark datasets, significantly surpassing existing state-of-the-art methods in terms of unmixing accuracy, model robustness, and computational efficiency.

关键词： Fusion mechanism Hyperspectral image Hyperspectral unmixing Mamba model Multi-Scale analysis

来源：评论

学校读者我要写书评

暂无评论

Multi-task Guided Blind Omnidirectional image Quality Assessment with Feature Interaction

引用

IEEE Transactions on Circuits and Systems for Video Technology 2025年

作者： Liu, Yun Li, Sifan Duan, Huiyu Zhou, Yu Fan, Daoxin Zhai, Guangtao Liaoning University Faculty of Information Shenyang110036 China Shanghai Jiao Tong University Institute of Image Communication and Information Processing Shanghai Key Laboratory of Digital Media Processing and Transmissions Shanghai200240 China China University of Mining and Technology School of Information and Control Engineering Xuzhou221116 China Xuzhou First People’s Hospital Xuzhou221116 China

Omnidirectional image quality assessment (OIQA) has become an increasingly vital problem in recent years. Most previous blind OIQA methods only extract local features from the distorted viewports, or extract global features from the entire distorted image, lacking the interaction and fusion between local and global features. Moreover, the lack of reference information also limits their performance. Thus, we propose a blind OIQA model which consists of three novel modules, including a bidirectional pseudo-reference module, a Mamba-based global feature extraction module, and a multi-scale local-global feature aggregation module. Specifically, by considering the image distortion degradation process, a bidirectional pseudo-reference module capturing the error maps on viewports is first constructed to refine the multi-scale local visual features, which can supply rich quality degradation reference information without the reference image. To well complement the local features, the VMamba module is adopted to extract the representative multi-scale global visual features. Inspired by human hierarchical visual perception characteristics, a novel multi-scale aggregation module is built to strengthen the feature interaction and effective fusion which can extract deep semantic information. Finally, motivated by the multi-task managing mechanism of human brain, a multi-task learning module is introduced to assist the main quality assessment task by digging the hidden information in compression type and distortion degree. Extensive experimental results demonstrate that our proposed method achieves the state-of-the-art performance on the blind OIQA task compared to other models. © 1991-2012 IEEE.

关键词： image quality

来源：评论

学校读者我要写书评

暂无评论

Autonomous Path Planning via Sand Cat Swarm Optimization With Multi-Strategy Mechanism for Unmanned Aerial Vehicles in Dynamic Environment

引用

IEEE Internet of Things Journal 2025年

作者： Deng, Wu Feng, Jiayi Zhao, Huimin Civil Aviation University of China College of Electronic Information and Automation Tianjin300300 China Civil Aviation University of China Tianjin Key Lab Intelligent Signal and Image Processing Tianjin300300 China State Key Laboratory of Rail Transit Vehicle System of Southwest Jiaotong University Chengdu610031 China

Unmanned Aerial Vehicles (UAVs) face critical challenges in path planning in dynamic environment. Sand Cat Swarm Optimization (SCSO) algorithm has demonstrated promise in addressing complex optimization challenges. However, SCSO is limited by slow convergence, susceptibility to local optima, and insufficient adaptability. To overcome these shortcomings, an enhanced SCSO with the spiral search, Livy flight, tent chaotic mapping, and adaptive sparrow alert mechanism, namely TSLS-SCSO is developed to propose an autonomous path planning method for UAVs in dynamic environment. In TSLS-SCSO, a new population initialization strategy with tent chaotic mapping is designed to achieve a large dynamic range and coverage capability. Then a new spiral search strategy is designed to broaden the search range in the search phase. And a new Livy flight strategy is employed to enrich the diversity of population in the attacking prey phase. A new sparrow alert mechanism with integrating the sand cat group with the sparrow alert is designed to obtain faster convergence speed and accuracy. The experiment results on CEC 2017 and CEC 2022 show that the TSLS-SCSO obtains higher accuracy and more stable solutions and exhibits better competitiveness. Furthermore, the proposed UAV path planning method successfully found effective paths with an obstacle avoidance effectiveness of 95.5%. The obtained results validate the effectiveness and competitiveness of TSLS-SCSO in UAV path planning in the dynamic environment. © 2014 IEEE.

关键词： Unmanned aerial vehicles (UAV)

来源：评论

学校读者我要写书评

暂无评论

Low-light image enhancement algorithm using a residual network with semantic information

引用

The Journal of China Universities of Posts and Telecommunications 2022年第2期29卷 52-62,84页

作者： Duan Lian Tang Guijin Jiangsu Key Laboratory of Image Processing and Image Communication Nanjing University of Posts and TelecommunicationsNanjing 210003China

Aiming to solve the poor performance of low illumination enhancement algorithms on uneven illumination images,a low-light image enhancement(LIME)algorithm based on a residual network was *** algorithm constructs a deep network that uses residual modules to extract image feature information and semantic modules to extract image semantic information from different ***,a composite loss function was also designed for the process of low illumination image enhancement,which dynamically evaluated the loss of an enhanced image from three factors of color,structure,and *** ensures that the model can correctly enhance the image features according to the image semantics,so that the enhancement results are more in line with the human visual *** results show that compared with the state-of-the-art algorithms,the semantic-driven residual low-light network(SRLLN)can effectively improve the quality of low illumination images,and achieve better subjective and objective evaluation indexes on different types of images.

关键词： image enhancement convolutional neural network(CNN) residual learning image semantics

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：