检索结果-内蒙古大学图书馆

2024 16th International Conference on Graphics and Image Processing, ICGIP 2024

作者： Sun, Liliang He, Yuanlie Li, Wensheng Feng, Fujian Liang, Yihui School of Computer Guangdong University of Technology Guangzhou510000 China School of Computer Science Zhongshan Institute University of Electronic Science and Technology of China Zhongshan528400 China Guizhou Key Laboratory of Pattern Recognition and Intelligent System Guizhou Minzu University Guiyang550025 China

ISBN: (数字)9781510688780

ISBN: (纸本)9781510688773

This paper focuses on the image composition of transparent objects, where existing image matting methods suffer from composition errors due to the lack of accurate foreground during the composition process. We propose a foreground prediction model named ALGM, which leverages the local feature extraction capabilities of Convolutional Neural Networks (CNNs) and incorporates an attention mechanism for global information modeling. The proposed alpha-assisted foreground prediction module extracts foreground information from the original image and conveys it. The extracted foreground color information is combined with the deep structural features of the encoder and used for foreground color prediction. ALGM reduces image composition errors in the quantitative data from the Composition-1k dataset and improves the visual quality of composed images on the AIM-500 and Transparent-460 datasets. © 2025 SPIE.

关键词： Prediction models

来源：评论

学校读者我要写书评

暂无评论

Visual Prompt Flexible-Modal Face Anti-Spoofing

引用

IEEE Transactions on Dependable and Secure Computing 2025年第3期22卷 2597-2606页

作者： Yu, Zitong Cai, Rizhao Cui, Yawen Liu, Ajian Chen, Changsheng Great Bay University School of Computing and Information Technology Dongguan523000 China Nanyang Technological University ROSE Lab School of EEE 639798 Singapore Hong Kong Polytechnic University Kowloon Hong Kong Chinese Academy of Sciences University of Chinese Academy of Sciences National Laboratory of Pattern Recognition Institute of Automation Beijing100190 China Shenzhen University Guangdong Key Laboratory of Intelligent Information Processing Shenzhen Key Laboratory of Media Security College of Electronics and Information Engineering Shenzhen518060 China

Recently, vision transformer based multimodal learning methods have been proposed to improve the robustness of face anti-spoofing (FAS) systems. However, multimodal face data collected from the real world is often imperfect due to missing modalities from various imaging sensors. Recently, flexible-modal FAS (Yu et al. 2023) has attracted more attention, which aims to develop a unified multimodal FAS model using complete multimodal face data but is insensitive to test-time missing modalities. In this paper, we tackle one main challenge in flexible-modal FAS, i.e., when missing modality occurs either during training or testing in real-world situations. Inspired by the recent success of the prompt learning in language models, we propose Visual Prompt flexible-modal FAS (VP-FAS), which learns the modal-relevant prompts to adapt the frozen pre-trained foundation model to downstream flexible-modal FAS task. Specifically, both vanilla visual prompts and residual contextual prompts are plugged into multimodal transformers to handle general missing-modality cases, while only requiring less than 4% learnable parameters compared to training the entire model. Furthermore, missing-modality regularization is proposed to force models to learn consistent multimodal feature embeddings when missing partial modalities. Extensive experiments conducted on two multimodal FAS benchmark datasets demonstrate the effectiveness of our VP-FAS framework that improves the performance under various missing-modality cases while alleviating the requirement of heavy model re-training. © 2004-2012 IEEE.

关键词： Alignment

来源：评论

学校读者我要写书评

暂无评论

Ocean archaea PPI prediction with pretraining models 25

Ocean archaea PPI prediction with pretraining models

引用

Proceedings of the 2025 5th International Conference on Bioinformatics and intelligent Computing

作者： Ying Zhang Yuan Liu Xiaoyong Pan Hongbin Shen Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University Shanghai China Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai China

ISBN: (纸本)9798400712203

Protein-Protein Interaction (PPI) provides important insights into the metabolic mechanisms of different biological processes. Although PPIs in some organisms have been investigated systematically, PPIs in the ocean archaea remain largely unexplored. But such species have special investigation value since their adaptation to extreme living conditions may generate unique PPIs. In this paper, we aim to characterize and predict PPIs in ocean archaea to advance understanding of their metabolic networks. First, we collect all ocean archaea PPIs with high confidence from STRING database and analyze the PPI network features, including centrality and enrichment analysis. The functional enrichment results of the largest connecting subgraph in the PPI network show most PPIs in our constructed dataset is related to the translation and transcription processes. Then, we generate an equal number of negative PPI pairs, whose members have either different subcellular locations or GO terms. We also use the generated dataset to test the performance of three pretraining methods and their ensemble methods in the binary PPI prediction task. Our results suggest the ensemble methods could be applied to further improve models’ performance. Fine-tuned models trained on the ocean archaea dataset are expected to predict the other ocean archaea PPIs that are not included in the STRING database and get more understanding about the ocean archaea PPI universe.

关键词： Binary PPI prediction

来源：评论

学校读者我要写书评

暂无评论

Efficient Image Super-Resolution With Feature Interaction Weighted Hybrid Network

引用

IEEE Transactions on Multimedia 2025年 27卷 2256-2267页

作者： Li, Wenjie Li, Juncheng Gao, Guangwei Deng, Weihong Yang, Jian Qi, Guo-Jun Lin, Chia-Wen Beijing University of Posts and Telecommunications Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing100080 China Shanghai University School of Communication and Information Engineering Shanghai200444 China Nanjing University of Posts and Telecommunications IVIPLab Institute of Advanced Technology Nanjing210046 China Ministry of Education Key Laboratory of Artificial Intelligence Shanghai200240 China Soochow University Provincial Key Laboratory for Computer Information Processing Technology Suzhou215006 China Nanjing University of Science and Technology School of Computer Science and Technology Nanjing210094 China Westlake University Research Center for Industries of the Future School of Engineering Hangzhou310024 China OPPO Research SeattleWA98101 United States National Tsing Hua University Department of Electrical Engineering Institute of Communications Engneering Hsinchu300044 Taiwan

Lightweight image super-resolution aims to reconstruct high-resolution images from low-resolution images using low computational costs. However, existing methods result in the loss of middle-layer features due to activation functions. To minimize the impact of intermediate feature loss on reconstruction quality, we propose a Feature Interaction Weighted Hybrid Network (FIWHN), which comprises a series of Wide-residual Distillation Interaction Block (WDIB) as the backbone. Every third WDIB forms a Feature Shuffle Weighted Group (FSWG) by applying mutual information shuffle and fusion. Moreover, to mitigate the negative effects of intermediate feature loss, we introduce Wide Residual Weighting units within WDIB. These units effectively fuse features of varying levels of detail through a Wide-residual Distillation Connection (WRDC) and a Self-Calibrating Fusion (SCF). To compensate for global feature deficiencies, we incorporate a Transformer and explore a novel architecture to combine CNN and Transformer. We show that our FIWHN achieves a favorable balance between performance and efficiency through extensive experiments on low-level and high-level tasks. © 1999-2012 IEEE.

关键词： Transformers Convolutional neural networks Computational modeling Feature extraction Training Superresolution Adaptation models Computer architecture Telecommunications Image reconstruction

来源：评论

学校读者我要写书评

暂无评论

Discovering the nuclear localization signal universe through a deep learning model with interpretable attention units

Patterns

引用

patterns 2025年

作者： Li, Yi-Fan Pan, Xiaoyong Shen, Hong-Bin Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University and Key Laboratory of System Control and Information Processing Ministry of Education of China Shanghai200240 China

We describe NLSExplorer, an interpretable approach for nuclear localization signal (NLS) prediction. By utilizing the extracted information on nuclear-specific sites from the protein language model to assist in NLS detection, NLSExplorer achieves superior performance with greater than 10% improvement in the F1 score compared with existing methods on benchmark datasets and highlights other nuclear transport segments. We applied NLSExplorer to the nucleus-localized proteins in the Swiss-Prot database to extract valuable segments. A comprehensive analysis of these segments revealed a potential NLS landscape and uncovered features of nuclear transport segments across 416 species. This study introduces a powerful tool for exploring the NLS universe and provides a versatile network that can efficiently detect characteristic domains and motifs. © 2025 The Author(s)

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

Fire Detection Based on Flame Enhancement for Weak Fires 19th

Fire Detection Based on Flame Enhancement for Weak Fires

引用

19th Chinese Conference on Image and Graphics Technologies and Applications, IGTA 2024

作者： Chen, Kuan Wen, Wen Feng, Fujian Xu, Xiang Liang, Yihui School of Computer Guangdong University of Technology Guangzhou510000 China School of Computer Science Zhongshan Institute University of Electronic Science and Technology of China Zhongshan528400 China Guizhou Key Laboratory of Pattern Recognition and Intelligent System Guizhou Minzu University Guiyang550025 China

ISBN: (纸本)9789819799183

Detecting weak fire, such as overexposed and highly transparent flames, remains a significant challenge in vision-based fire detection. Convolutional Neural Network (CNN) based methods are widely used for automatic fire feature extraction, but they struggle to accurately recognize overexposed flames similar to the background and highly transparent flames that blend with the background, leading to false negative fire detection results. To address this issue, we have established a large-scale fire detection dataset with weak flames and introduce a fire detection method based on flame context enhancement. While employing a flame feature extraction module to identify and delineate the potential flame area, the proposed method primarily introduces a flame context module to capture the effective features of weak flames from this area, significantly enhancing the understanding of fires. Experimental results show that the proposed method can effectively reduce false negatives and improves the recall rate for detecting weak flames. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Premixed flames

来源：评论

学校读者我要写书评

暂无评论

Adaptive Pixel Pair Generation Strategy for Image Matting Methods Based on Pixel Pair Optimization 19th

Adaptive Pixel Pair Generation Strategy for Image Matting Me...

引用

19th Chinese Conference on Image and Graphics Technologies and Applications, IGTA 2024

作者： Zheng, Jiamin Wen, Wen Liang, Yihui Feng, Fujian Xu, Xiang School of Computer Guangdong University of Technology Guangzhou510000 China School of Computer Science Zhongshan Institute University of Electronic Science and Technology of China Zhongshan528400 China Guizhou Key Laboratory of Pattern Recognition and Intelligent System Guizhou Minzu University Guiyang550025 China

ISBN: (纸本)9789819799183

Natural image matting plays a crucial role in numerous real-world applications. Image matting methods based on pixel pair optimization is a type of matting algorithm, which has significant advantages in parallel computation, handling images with similar foreground and background, and operating under limited computing time. However, these methods cannot provide high-quality alpha mattes for high-resolution images within limited computational resources. In this paper, we design an adaptive pixel pair generation strategy to solve the above problem. This strategy adaptively generates pixel pair for the unknown pixel according to its estimated alpha value, which promotes diversity of pixel pair and improves the efficiency of pixel pair optimization. It categorizes unknown pixels into three types and additionally incorporates nearby foreground and background pixels to generate pixel pair. Experimental results show that using our strategy can achieve high-quality alpha mattes and competitive matting performance under limited computational resources. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Pixels

来源：评论

学校读者我要写书评

暂无评论

Adaptive Multi-Resolution Feature Fusion for Fine-Grained Visual Classification

引用

IEEE Transactions on Circuits and systems for Video Technology 2025年

作者： Yang, Yuqi Chang, Dongliang Du, Ruoyi Song, Yi-Zhe Ma, Zhanyu Beijing University of Posts and Telecommunications Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing100876 China Tsinghua University Department of Automation Beijing100084 China University of Surrey SketchX CVSSP GuildfordGU2 7XH United Kingdom

Despite significant progress, the shortage of labeled data and expert knowledge remains a challenge for Fine-grained Visual Classification (FGVC). Some multi-source approaches that incorporate additional modalities, such as sound or bounding boxes, show promise for data enrichment but introduce added complexity to data collection. In this paper, we pose the question: can multi-source capabilities be achieved solely with existing images? The answer, confirmed by a pilot study, is affirmative. By analyzing the probability distribution of model output with different resolutions image, we find that complementary information beneficial to FGVC exists among images of different resolutions. Although the classification accuracy of low-resolution images is lower than high-resolution images, it can provide additional information for high-resolution input images. We designed a naive baseline that uses mixed training of multi-resolution images. Through the experimental results of the baseline, we find that i) not all low-resolution images are beneficial, and ii) adaptively selecting low-resolution images is what we need. Therefore, we proposed a meta-learning-based adaptive "resolution" pooling layer. Through the pooling operation, the features of low-resolution images are obtained from high-resolution images, and the most appropriate complementary features are selected for the features of high-resolution images through the gating mechanism, which enables the model to fully and autonomously exploit the complementary information. Experimental results on three FGVC datasets validate the effectiveness of our proposed method. Our code is available at https://***/PRIS-CV/Adaptive-Multi-Resolution-Feature-Fusion. © 2025 IEEE. All rights reserved.

关键词： Information fusion

来源：评论

学校读者我要写书评

暂无评论

Zero-Shot Audio Captioning Using Soft and Hard Prompts

IEEE Transactions on Audio, Speech and Language Processing

引用

IEEE Transactions on Audio, Speech and Language Processing 2025年 33卷 2045-2058页

作者： Yiming Zhang Xuenan Xu Ruoyi Du Haohe Liu Yuan Dong Zheng-Hua Tan Wenwu Wang Zhanyu Ma Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China Department of Computer Science and Engineering Shanghai Jiao Tong University Shanghai China Centre for Vision Speech and Signal Processing University of Surrey Guildford U.K. Department of Electronic Systems Aalborg University Aalborg Denmark

In traditional audio captioning methods, a model is usually trained in a fully supervised manner using a human-annotated dataset containing audio-text pairs and then evaluated on the test set from the same dataset. Such methods have two limitations. First, these methods are often data-hungry and require time-consuming and expensive human annotations to obtain audio-text pairs. Second, these models often suffer from performance degradation in cross-domain scenarios, i.e., when the input audio comes from a different domain than the training set, and this issue has received little attention. To address these issues, we propose a new zero-shot method for audio captioning. Our method is built on the contrastive language-audio pre-training (CLAP) model. During training, the model reconstructs the ground-truth caption using the CLAP text encoder. In the inference stage, the model generates text descriptions from the CLAP audio embeddings of given audio inputs. To enhance the ability of the model in transitioning from text-to-text generation to audio-to-text generation, we propose to use the mixed-augmentations-based soft prompt to learn more robust latent representations, leveraging instance replacement and embedding augmentation. Additionally, we introduce the retrieval-based acoustic-aware hard prompt to improve the cross-domain performance of the model by employing the domain-agnostic label information of sound events. Extensive experiments on AudioCaps and Clotho benchmarks show the effectiveness of our proposed method, which outperforms other zero-shot audio captioning approaches for in-domain scenarios and outperforms the compared methods for cross-domain scenarios, underscoring the generalization ability of our method.

关键词： Training Decoding Semantics Data models Acoustics Electronic mail Benchmark testing Transformers Robustness Perturbation methods

来源：评论

学校读者我要写书评

暂无评论

Thermal-Torsion Coupling Loading Analysis and Optimization of 3D PoP Assembly Solder Joints at Different Temperatures

引用

IEEE Transactions on Components, Packaging and Manufacturing Technology 2025年

作者： Gao, Chao Huang, Chunyue Liang, Yin Dian, Chen Lan, Jingyi Wang, Gui Guilin University of Electronic Technology School of Electrical and Mechanical Engineering Guilin541004 China Chengdu University Key Laboratory of Pattern Recognition and Intelligent Information Processing Institutions of Higher Education of Sichuan Province Chengdu610106 China Chengdu Aeronautic Vocational and Technical College Chengdu610021 China

A simulation analysis was conducted to investigate the stress distribution of Package-on-Package (PoP) assembly array solder joints subjected to thermal-torsional coupling loads, with the validity of the simulation confirmed through coupled loading stress-strain measurement experiments. The volume-weighted average method was employed to calculate the average equivalent stress (Δσ) of the critical solder joint danger element layer within the PoP assembly array, using Δσ as the evaluation benchmark. The impact and sensitivity of structural parameters on the thermal-torsional coupling stress of solder joints were examined. A structural parameter sensitivity model was developed to facilitate the stability and optimization analysis of the structural parameter intervals. The results indicate that solder joints in the lower array of the PoP assembly experience higher thermal-torsional coupling stress, with the peak internal stress occurring at the interface between the solder joint and the copper pad. The variation in thermal-torsional coupling stress of the array solder joints is more pronounced in the low-temperature region compared to the high-temperature region, with maximum stress occurring at -55°C and minimum stress observed at 125°C. Within the structural parameter range, the Δσ value of the critical solder joint shows a negative correlation with solder joint height, solder joint diameter, and substrate thickness, and a positive correlation with PCB thickness. The sensitivity to structural parameters follows the order: solder joint diameter, solder joint height, PCB thickness, and substrate thickness. Finally, the optimal range of structural parameters was determined, and the stability of this range was assessed. © 2011-2012 IEEE.

关键词： Sensitivity analysis

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：