检索结果-内蒙古大学图书馆

IEEE Transactions on Audio, Speech and Language Processing 2025年 33卷 2045-2058页

作者： Yiming Zhang Xuenan Xu Ruoyi Du Haohe Liu Yuan Dong Zheng-Hua Tan Wenwu Wang Zhanyu Ma Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing China Department of Computer Science and Engineering Shanghai Jiao Tong University Shanghai China Centre for Vision Speech and Signal Processing University of Surrey Guildford U.K. Department of Electronic Systems Aalborg University Aalborg Denmark

In traditional audio captioning methods, a model is usually trained in a fully supervised manner using a human-annotated dataset containing audio-text pairs and then evaluated on the test set from the same dataset. Such methods have two limitations. First, these methods are often data-hungry and require time-consuming and expensive human annotations to obtain audio-text pairs. Second, these models often suffer from performance degradation in cross-domain scenarios, i.e., when the input audio comes from a different domain than the training set, and this issue has received little attention. To address these issues, we propose a new zero-shot method for audio captioning. Our method is built on the contrastive language-audio pre-training (CLAP) model. During training, the model reconstructs the ground-truth caption using the CLAP text encoder. In the inference stage, the model generates text descriptions from the CLAP audio embeddings of given audio inputs. To enhance the ability of the model in transitioning from text-to-text generation to audio-to-text generation, we propose to use the mixed-augmentations-based soft prompt to learn more robust latent representations, leveraging instance replacement and embedding augmentation. Additionally, we introduce the retrieval-based acoustic-aware hard prompt to improve the cross-domain performance of the model by employing the domain-agnostic label information of sound events. Extensive experiments on AudioCaps and Clotho benchmarks show the effectiveness of our proposed method, which outperforms other zero-shot audio captioning approaches for in-domain scenarios and outperforms the compared methods for cross-domain scenarios, underscoring the generalization ability of our method.

关键词： Training Decoding Semantics Data models Acoustics Electronic mail Benchmark testing Transformers Robustness Perturbation methods

来源：评论

学校读者我要写书评

暂无评论

computer vision Approaches for Automated Bee Counting Application

引用

IFAC-PapersOnLine 2024年第9期58卷 43-48页

作者： Simon Bilik Ilona Janakova Adam Ligocki Dominik Ficek Karel Horak Department of Control and Instrumentation Faculty of Electrical Engineering and Communication Brno University of Technology Brno Czech Republic and Computer Vision and Pattern Recognition Laboratory Department of Computational Engineering Lappeenranta-Lahti University of Technology LUT Lappeenranta Finland Department of Control and Instrumentation Faculty of Electrical Engineering and Communication Brno University of Technology Brno Czech Republic

Many application from the bee colony health state monitoring could be efficiently solved using a computer vision techniques. One of such challenges is an efficient way for counting the number of incoming and outcoming bees, which could be used to further analyse many trends, such as the bee colony health state, blooming periods, or for investigating the effects of agricultural spraying. In this paper, we compare three methods for the automated bee counting over two own datasets. The best performing method is based on the ResNet-50 convolutional neural network classifier, which achieved accuracy of 87% over the BUT1 dataset and the accuracy of 93% over the BUT2 dataset.

关键词： Signal Processing Biomedical systems bee counting bee traffic monitoring computer vision deep classification object detection

来源：评论

学校读者我要写书评

暂无评论

Antigen-specific antibody design via direct energy-based preference optimization 24

Antigen-specific antibody design via direct energy-based pre...

引用

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Xiangxin Zhou Dongyu Xue Ruizhe Chen Zaixiang Zheng Liang Wang Quanquan Gu School of Artificial Intelligence University of Chinese Academy of Sciences and New Laboratory of Pattern Recognition (NLPR) State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS) Institute of Automation Chinese Academy of Sciences (CASIA) and ByteDance Research ByteDance Research College of Computer Science and Electronic Engineering Hunan University and ByteDance Research School of Artificial Intelligence University of Chinese Academy of Sciences and New Laboratory of Pattern Recognition (NLPR) State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS) Institute of Automation Chinese Academy of Sciences (CASIA)

ISBN: (纸本)9798331314385

Antibody design, a crucial task with significant implications across various disciplines such as therapeutics and biology, presents considerable challenges due to its intricate nature. In this paper, we tackle antigen-specific antibody sequence-structure co-design as an optimization problem towards specific preferences, considering both rationality and functionality. Leveraging a pre-trained conditional diffusion model that jointly models sequences and structures of antibodies with equivariant neural networks, we propose direct energy-based preference optimization to guide the generation of antibodies with both rational structures and considerable binding affinities to given antigens. Our method involves fine-tuning the pre-trained diffusion model using a residue-level decomposed energy preference. Additionally, we employ gradient surgery to address conflicts between various types of energy, such as attraction and repulsion. Experiments on RAbD benchmark show that our approach effectively optimizes the energy of generated antibodies and achieves state-of-the-art performance in designing high-quality antibodies with low total energy and high binding affinity simultaneously, demonstrating the superiority of our approach.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Isoform Function Prediction Based on Heterogeneous Graph Attention Networks

Isoform Function Prediction Based on Heterogeneous Graph Att...

引用

2023 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2023

作者： Guo, Kuo Li, Yifan Chen, Hao Shen, Hong-Bin Yang, Yang Shanghai Jiao Tong University Key Lab. of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering Department of Computer Science and Engineering Shanghai200240 China Shanghai Jiao Tong University Key Laboratory of System Control and Information Processing Ministry of Education of China Institute of Image Processing and Pattern Recognition Shanghai200240 China Carnegie Mellon University School of Computer Science Computational Biology Department PittsburghPA15213 United States

ISBN: (纸本)9798350337488

Isoforms refer to different mRNA molecules transcribed from the same gene, which can be translated into proteins with varying structures and functions. Predicting the functions of isoforms is an essential topic in bioinformatics as it can provide valuable insights into the intricate mechanisms of gene regulation and biological processes. Conventionally, gene function labels are standardized in Gene Ontology (GO) terms. However, traditional methods for predicting isoform function are largely limited by the absence of isoform-specific labels, sparse annotations, and the vast number of GO terms. To address these issues, we propose HANIso, a deep learning-based method for isoform function prediction. HANIso leverages a pretrained protein language model to extract features from protein sequences. It also integrates heterogeneous information, such as isoform sequence features, GO annotations, and isoform interaction data, using a Heterogeneous Graph Attention Network (HAN). This allows the model to learn the importance of different sources of information and their semantic relationships through the attention mechanism. Our method can predict function labels at both the gene level and isoform level. We conduct experiments on two species datasets, and the results demonstrate that our method outperforms existing methods on both AUROC and AUPRC. HANIso has the potential to overcome the limitations of traditional methods and provide a more accurate and comprehensive understanding of isoform function. © 2023 IEEE.

关键词： alternative splicing gene ontology heterogeneous graph attention network isoform function prediction protein language model

来源：评论

学校读者我要写书评

暂无评论

Fire Detection Based on Flame Enhancement for Weak Fires 19th

Fire Detection Based on Flame Enhancement for Weak Fires

引用

19th Chinese Conference on Image and Graphics Technologies and Applications, IGTA 2024

作者： Chen, Kuan Wen, Wen Feng, Fujian Xu, Xiang Liang, Yihui School of Computer Guangdong University of Technology Guangzhou510000 China School of Computer Science Zhongshan Institute University of Electronic Science and Technology of China Zhongshan528400 China Guizhou Key Laboratory of Pattern Recognition and Intelligent System Guizhou Minzu University Guiyang550025 China

ISBN: (纸本)9789819799183

Detecting weak fire, such as overexposed and highly transparent flames, remains a significant challenge in vision-based fire detection. Convolutional Neural Network (CNN) based methods are widely used for automatic fire feature extraction, but they struggle to accurately recognize overexposed flames similar to the background and highly transparent flames that blend with the background, leading to false negative fire detection results. To address this issue, we have established a large-scale fire detection dataset with weak flames and introduce a fire detection method based on flame context enhancement. While employing a flame feature extraction module to identify and delineate the potential flame area, the proposed method primarily introduces a flame context module to capture the effective features of weak flames from this area, significantly enhancing the understanding of fires. Experimental results show that the proposed method can effectively reduce false negatives and improves the recall rate for detecting weak flames. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Premixed flames

来源：评论

学校读者我要写书评

暂无评论

IFAST: Weakly Supervised Interpretable Face Anti-spoofing from Single-shot Binocular NIR Images

arXiv

引用

arXiv 2023年

作者： Huang, Jiancheng Zhou, Donghao Chen, Shifeng ShenZhen Key Lab of Computer Vision and Pattern Recognition Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China University of Chinese Academy of Sciences Beijing China Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China The Chinese University of Hong Kong Hong Kong

Single-shot face anti-spoofing (FAS) is a key technique for securing face recognition systems, and it requires only static images as input. However, single-shot FAS remains a challenging and under-explored problem due to two main reasons: 1) on the data side, learning FAS from RGB images is largely context-dependent, and single-shot images without additional annotations contain limited semantic information. 2) on the model side, existing single-shot FAS models are infeasible to provide proper evidence for their decisions, and FAS methods based on depth estimation require expensive per-pixel annotations. To address these issues, a large binocular NIR image dataset (BNI-FAS) is constructed and published, which contains more than 300,000 real face and plane attack images, and an Interpretable FAS Transformer (IFAST) is proposed that requires only weak supervision to produce interpretable predictions. Our IFAST can produce pixel-wise disparity maps by the proposed disparity estimation Transformer with Dynamic Matching Attention (DMA) block. Besides, a well-designed confidence map generator is adopted to cooperate with the proposed dual-teacher distillation module to obtain the final discriminant results. The comprehensive experiments show that our IFAST can achieve state-of-the-art results on BNI-FAS, proving the effectiveness of the single-shot FAS based on binocular NIR images. Copyright © 2023, The Authors. All rights reserved.

关键词： Distillation

来源：评论

学校读者我要写书评

暂无评论

Adaptive Pixel Pair Generation Strategy for Image Matting Methods Based on Pixel Pair Optimization 19th

Adaptive Pixel Pair Generation Strategy for Image Matting Me...

引用

19th Chinese Conference on Image and Graphics Technologies and Applications, IGTA 2024

作者： Zheng, Jiamin Wen, Wen Liang, Yihui Feng, Fujian Xu, Xiang School of Computer Guangdong University of Technology Guangzhou510000 China School of Computer Science Zhongshan Institute University of Electronic Science and Technology of China Zhongshan528400 China Guizhou Key Laboratory of Pattern Recognition and Intelligent System Guizhou Minzu University Guiyang550025 China

ISBN: (纸本)9789819799183

Natural image matting plays a crucial role in numerous real-world applications. Image matting methods based on pixel pair optimization is a type of matting algorithm, which has significant advantages in parallel computation, handling images with similar foreground and background, and operating under limited computing time. However, these methods cannot provide high-quality alpha mattes for high-resolution images within limited computational resources. In this paper, we design an adaptive pixel pair generation strategy to solve the above problem. This strategy adaptively generates pixel pair for the unknown pixel according to its estimated alpha value, which promotes diversity of pixel pair and improves the efficiency of pixel pair optimization. It categorizes unknown pixels into three types and additionally incorporates nearby foreground and background pixels to generate pixel pair. Experimental results show that using our strategy can achieve high-quality alpha mattes and competitive matting performance under limited computational resources. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Pixels

来源：评论

学校读者我要写书评

暂无评论

Combining feature aggregation and geometric similarity for re-identification of patterned animals

arXiv

引用

arXiv 2023年

作者： Immonen, Veikka Nepovinnykh, Ekaterina Eerola, Tuomas Stewart, Charles V. Kälviäinen, Heikki Computer Vision and Pattern Recognition Laboratory Department of Computational Engineering School of Engineering Sciences Lappeenranta-Lahti University of Technology LUT LappeenrantaFI-53851 Finland Department of Computer Science Rensselaer Polytechnic Institute TroyNY12180 United States

Image-based re-identification of animal individuals allows gathering of information such as migration patterns of the animals over time. This, together with large image volumes collected using camera traps and crowdsourcing, opens novel possibilities to study animal populations. For many species, the re-identification can be done by analyzing the permanent fur, feather, or skin patterns that are unique to each individual. In this paper, we address the re-identification by combining two types of pattern similarity metrics: 1) pattern appearance similarity obtained by pattern feature aggregation and 2) geometric pattern similarity obtained by analyzing the geometric consistency of pattern similarities. The proposed combination allows to efficiently utilize both the local and global pattern features, providing a general re-identification approach that can be applied to a wide variety of different pattern types. In the experimental part of the work, we demonstrate that the method achieves promising re-identification accuracies for Saimaa ringed seals and whale sharks. © 2023, CC BY-NC-SA.

关键词： Animals

来源：评论

学校读者我要写书评

暂无评论

Handwritten Mathematical Expression recognition with Self-Attention 21

Handwritten Mathematical Expression Recognition with Self-At...

引用

Proceedings of the 2021 4th International Conference on Algorithms, Computing and Artificial Intelligence

作者： Xueke Chi Da-Han Wang Yuefeng Wu Yun Wu Fujian Key Laboratory of Pattern Recognition and Image Understanding China and School of Computer and Information Engineering Xiamen University of Technology China

ISBN: (纸本)9781450385053

Attention-based encoder-decoder models have made great success on handwritten mathematical expression recognition in recent years. However, this kind of method has the problem of attention drift, because under the local attention mechanism based on RNN, the high similarity between coding features can cause attention confusion. To settle this problem, we propose an encoder-decoder model with self-attention, which captures the global information of the feature map and fuses the local information of the CNN as complementary features. Experiments are conducted on the CROHME2014 and CROHME 2016 competition datasets. The experimental results show that, when only using the official training dataset, the proposed method achieves recognition accuracies of 51.98% and 50.74% on the CROHME2014 and CROHME2016 competition datasets, respectively, which outperforms the other methods significantly. The improvements demonstrate the effectiveness of the self-attention module.

关键词： handwritten mathematical expression offline recognition non-local self-attention

来源：评论

学校读者我要写书评

暂无评论

ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Framework

arXiv

引用

arXiv 2022年

作者： Mo, Ningkai Gan, Wanshui Yokoya, Naoto Chen, Shifeng ShenZhen Key Lab of Computer Vision and Pattern Recognition Shenzhen Institute of Advanced Technology Chinese Academy of Sciences China The University of Tokyo Japan RIKEN Japan

In this paper, a computation efficient regression framework is presented for estimating the 6D pose of rigid objects from a single RGB-D image, which is applicable to handling symmetric objects. This framework is designed in a simple architecture that efficiently extracts point-wise features from RGB-D data using a fully convolutional network, called XYZNet, and directly regresses the 6D pose without any post refinement. In the case of symmetric object, one object has multiple ground-truth poses, and this one-to-many relationship may lead to estimation ambiguity. In order to solve this ambiguity problem, we design a symmetry-invariant pose distance metric, called average (maximum) grouped primitives distance or A(M)GPD. The proposed A(M)GPD loss can make the regression network converge to the correct state, i.e., all minima in the A(M)GPD loss surface are mapped to the correct poses. Extensive experiments on YCB-Video and TLESS datasets demonstrate the proposed framework's substantially superior performance in top accuracy and low computational cost. The relevant code is available in https://***/GANWANSHUI/***. Copyright © 2022, The Authors. All rights reserved.

关键词： Computational efficiency

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：