检索结果-内蒙古大学图书馆

Improved Far-field Speaker Recognition Method Based Geometry Acoustic Simulation and SpecAugment

学校读者我要写书评

暂无评论

Improved Far-field Speaker Recognition Method Based Geometry...

2021 International Conference on Intelligent Computing, Automation and Applications, ICAA 2021

作者： Lian, Yingzi Pang, Jing Inner Mongolia University of Technology College of Science Hohhot China Inner Mongolia Key Lab. of Statistical Analysis Theory for Life Data and Neural Network Modeling Inner Mongolia University of Technology Hohhot China

ISBN: (纸本)9781665437301

Deep learning method has made a great breakthrough in the field of speaker recognition. However, the performance of deep learning method based neural network often degrade in far-field speaker recognition task, with respect to the near-field. One of the indispensable factors is that deep learning performance has a great impact on the quality and diversity of data. Utterance in far-field scenario always mixed with variant reverberation and noise which could interfere the prediction of model. In this paper, we proposed a novel method comprised of geometry acoustic simulation (GAS) and SpecAugment, which makes the performance of deep learning method on far-field speaker recognition task more stable and excellent. Based on near-field speech dataset, by means of physical simulation, far-field speech with different types and characters can be generated to provide as many scenes as possible for speaker recognition. Simultaneously, the SpecAugment method has been applied to enhance the diversity of utterance data on mel-spectrogram. Then, ResNet34 and AM-Softmax Loss were used as the most commonly used methods for feature extraction and model training. Our proposed method has been trained on Voxceleb1 and V oxceleb2 dataset, and test on Vox celeb original test set. Evaluations show that our proposed method has 46% and 40% of EER and minDCF relatively improvement on far-field speaker recognition task. © 2021 IEEE.

关键词： Deep learning

RoKEPG: RoBERTa and Knowledge Enhancement for Prescription Generation of Traditional Chinese Medicine

学校读者我要写书评

暂无评论

RoKEPG: RoBERTa and Knowledge Enhancement for Prescription G...

IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

作者： Hua Pu Jiacong Mi Shan Lu Jieyue He School of Computer Science and Engineering Key Lab of Computer Network and Information Integration MOE Southeast University Nanjing China Nanjing Fenghuo Tiandi Communication Technology Co. Ltd Nanjing China

Traditional Chinese medicine (TCM) prescription is the most critical form of TCM treatment, and uncovering the complex nonlinear relationship between symptoms and TCM is of great significance for clinical practice and assisting physicians in diagnosis and treatment. Although there have been some studies on TCM prescription generation, these studies consider a single factor and directly model the symptom-prescription generation problem mainly based on symptom descriptions, lacking guidance from TCM knowledge. To this end, we propose a RoBERTa and Knowledge Enhancement model for Prescription Generation of Traditional Chinese Medicine (RoKEPG). RoKEPG is firstly pre-trained by our constructed TCM corpus, followed by fine-tuning the pre-trained model, and the model is guided to generate TCM prescriptions by introducing four classes of knowledge of TCM through the attention mask matrix. Experimental results on the publicly available TCM prescription dataset show that RoKEPG improves the F 1 metric by about 2% over the baseline model with the best results.

关键词：

Dear-DIA^(XMBD): Deep Autoencoder Enables Deconvolution of Data-Independent Acquisition Proteomics

学校读者我要写书评

暂无评论

Research 2024年第1期6卷 707-720页

作者： Qingzu He Chuan-Qi Zhong Xiang Li Huan Guo Yiming Li Mingxuan Gao Rongshan Yu Xianming Liu Fangfei Zhang Donghui Guo Fangfu Ye Tiannan Guo Jianwei Shuai Jiahuai Han Department of Physics and Fujian Provincial Key Laboratory for Soft Functional Materials ResearchXiamen UniversityXiamen 361005China Oujiang Laboratory(Zhejiang Lab for Regenerative Medicine Vision and Brain Health)and Wenzhou InstituteUniversity of Chinese Academy of SciencesWenzhouZhejiang 325001China School of Life Sciences Xiamen UniversityXiamen 361102China State Key Laboratory of Cellular Stress Biology Innovation Center for Cell Signaling NetworkXiamen 361102China Department of Computer Science Xiamen UniversityXiamen 361005China National Institute for Data Science in Health and Medicine School of MedicineXiamen UniversityXiamen 361102China Bruker(Beijing)Scientific Technology Co.Ltd. BeijingChina Westlake Laboratory of Life Sciences and Biomedicine Key Laboratory of Structural Biology of Zhejiang ProvinceSchool of Life SciencesWestlake University18 Shilongshan RoadHangzhou 310024China Institute of Basic Medical Sciences Westlake Institute for Advanced Study18 Shilongshan RoadHangzhou 310024China Westlake Omics Ltd. Yunmeng Road 1HangzhouChina Department of Electronic Engineering Xiamen UniversityXiamen 361005China

Data-independent acquisition(DIA)technology for protein identification from mass spectrometry and related algorithms is developing *** spectrum-centric analysis of DIA data without the use of spectra library from data-dependent acquisition data represents a promising *** this paper,we proposed an untargeted analysis method,Dear-DIA^(XMBD),for direct analysis of DIA ***-DIA^(XMBD) first integrates the deep variational autoencoder and triplet loss to learn the representations of the extracted fragment ion chromatograms,then uses the k-means clustering algorithm to aggregate fragments with similar representations into the same classes,and finally establishes the inverted index tables to determine the precursors of fragment clusters between precursors and peptides and between fragments and *** show that Dear-DIA^(XMBD) performs superiorly with the highly complicated DIA data of different species obtained by different instrument platforms.

关键词： Deep Auto Independent

Human Attention Based Movie Summarization: Dataset and Baseline Model

学校读者我要写书评

暂无评论

Human Attention Based Movie Summarization: Dataset and Basel...

2022 IEEE International Conference on Multimedia and Expo, ICME 2022

作者： Zhao, Defang Zhu, Dandan Min, Xiongkuo Yue, Jiaomin Zhang, Kaiwei Zhou, Qiangqiang Zhai, Guangtao Yang, Xiaokang CloudWalk Technology Shanghai China School of Computer Science and Technology Donghua University Shanghai China Institute of Image Communication and Network Engineering Shanghai Jiao Tong University Shanghai China School of Software Jiangxi Normal University Nanchang China Ai Institute Shanghai Jiao Tong University MOE Key Lab of Artificial Intelligence Shanghai China

ISBN: (数字)9781665485630

ISBN: (纸本)9781665485630

The movie summarization model can automatically edit a condensed and succinct version of the movie by selecting the keyframes. Previous works mainly resort to hand-crafted heuristics and most of them are unsupervised. Supervised movie summarization is a new research field and, there is currently no publicly suitable dataset available. Moreover, existing works only focus on the movies themselves while neglecting the audiences, who have the most say in which part of the movie is more attractive. To deal with the aforementioned limitations, we establish a human attention based movie summarization dataset Movie50. Specifically, we explore the human attention variations when watching videos and have the following findings: (1) The attention of humans is concentrated when watching keyframes. (2) The attention of humans is distracted when watching non-keyframes. Inspired by these findings, we collect the eye fixations of 20 participants when watching 50 movies and propose a novel human attention based annotation pipeline. In addition, we introduce A/V-MSNet, an audiovisual neural network that takes advantage of spatio-temporal visual and auditory information to better model human attention as well as exploit more plentiful information. Extensive experiments demonstrate the superiority of the proposed method. © 2022 IEEE.

关键词： Motion pictures

LegoNet: A Fast and Exact Unlearning Architecture

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Yu, Sihao Sun, Fei Guo, Jiafeng Zhang, Ruqing Cheng, Xueqi University of Chinese Academy of Sciences Beijing China CAS Key Lab of Network Data Science and Technology Institute of Computing Technology Chinese Academy of Sciences Beijing China

Machine unlearning aims to erase the impact of specific training samples upon deleted requests from a trained model. Retraining the model on the retained data after deletion is an effective but not efficient way due to the huge number of model parameters and re-training samples. To speed up, a natural way is to reduce such parameters and samples. However, such a strategy typically leads to a loss in model performance, which poses the challenge that increasing the unlearning efficiency while maintaining acceptable performance. In this paper, we present a novel network, namely LegoNet, which adopts the framework of "fixed encoder + multiple adapters". We fix the encoder (i.e., the backbone for representation learning) of LegoNet to reduce the parameters that need to be re-trained during unlearning. Since the encoder occupies a major part of the model parameters, the unlearning efficiency is significantly improved. However, fixing the encoder empirically leads to a significant performance drop. To compensate for the performance loss, we adopt the ensemble of multiple adapters, which are independent sub-models adopted to infer the prediction by the encoding (i.e., the output of the encoder). Furthermore, we design an activation mechanism for the adapters to further trade off unlearning efficiency against model performance. This mechanism guarantees that each sample can only impact very few adapters, so during unlearning, parameters and samples that need to be re-trained are both reduced. The empirical experiments verify that LegoNet accomplishes fast and exact unlearning while maintaining acceptable performance, synthetically outperforming unlearning baselines. © 2022, CC BY-NC-ND.

关键词： Efficiency

Pre-train a Discriminative Text Encoder for Dense Retrieval via Contrastive Span Prediction

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Ma, Xinyu Guo, Jiafeng Zhang, Ruqing Fan, Yixing Cheng, Xueqi CAS Key Lab of Network Data Science and Technology Institute of Computing Technology Chinese Academy of Sciences Beijing China University of Chinese Academy of Sciences Beijing China

Dense retrieval has shown promising results in many information retrieval (IR) related tasks, whose foundation is high-quality text representation learning for effective search. Some recent studies have shown that autoencoder-based language models are able to boost the dense retrieval performance using a weak decoder. However, we argue that 1) it is not discriminative to decode all the input texts and, 2) even a weak decoder has the bypass effect on the encoder. Therefore, in this work, we introduce a novel contrastive span prediction task to pre-train the encoder alone, but still retain the bottleneck ability of the autoencoder. The key idea is to force the encoder to generate the text representation close to its own random spans while far away from others using a group-wise contrastive loss. In this way, we can 1) learn discriminative text representations efficiently with the group-wise contrastive learning over spans and, 2) avoid the bypass effect of the decoder thoroughly. Comprehensive experiments over publicly available retrieval benchmark datasets show that our approach can outperform existing pre-training methods for dense retrieval significantly. Code and pre-trained models will be available at the URL. Copyright © 2022, The Authors. All rights reserved.

关键词： Signal encoding

Visual Named Entity Linking: A New Dataset and A Baseline

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Sun, Wenxiang Fan, Yixing Guo, Jiafeng Zhang, Ruqing Cheng, Xueqi CAS Key Lab of Network Data Science and Technology Institute of Computing Technology Chinese Academy of Sciences Beijing China University of Chinese Academy of Sciences Beijing China

Visual Entity Linking (VEL) is a task to link regions of images with their corresponding entities in Knowledge Bases (KBs), which is beneficial for many computer vision tasks such as image retrieval, image caption, and visual question answering. While existing tasks in VEL either rely on textual data to complement a multi-modal linking or only link objects with general entities, which fails to perform named entity linking on large amounts of image data. In this paper, we consider a purely Visual-based Named Entity Linking (VNEL) task, where the input only consists of an image. The task is to identify objects of interest (i.e., visual entity mentions) in images and link them to corresponding named entities in KBs. Since each entity often contains rich visual and textual information in KBs, we thus propose three different sub-tasks, i.e., visual to visual entity linking (V2VEL), visual to textual entity linking (V2TEL), and visual to visual-textual entity linking (V2VTEL). In addition, we present a high-quality human-annotated visual person linking dataset, named WIKIPerson. Based on WIKIPerson, we establish a series of baseline algorithms for the solution of each sub-task, and conduct experiments to verify the quality of the proposed datasets and the effectiveness of baseline methods. We envision this work to be helpful for soliciting more works regarding VNEL in the future. Copyright © 2022, The Authors. All rights reserved.

关键词： Image retrieval

On the Effectiveness of Function-Level Vulnerability Detectors for Inter-Procedural Vulnerabilities

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Li, Zhen Wang, Ning Zou, Deqing Li, Yating Zhang, Ruqian Xu, Shouhuai Zhang, Chao Jin, Hai School of Cyber Science and Engineering Huazhong University of Science and Technology Wuhan China Department of Computer Science University of Colorado Colorado Springs Colorado SpringsCO United States Institute for Network Sciences and Cyberspace Tsinghua University Beijing China School of Computer Science and Technology Huazhong University of Science and Technology Wuhan China National Engineering Research Center for Big Data Technology and System Services Computing Technology and System Lab Hubei Key Laboratory of Distributed System Security Hubei Engineering Research Center on Big Data Security Cluster and Grid Computing Lab China JinYinHu Laboratory Wuhan China

Software vulnerabilities are a major cyber threat and it is important to detect them. One important approach to detecting vulnerabilities is to use deep learning while treating a program function as a whole, known as function-level vulnerability detectors. However, the limitation of this approach is not understood. In this paper, we investigate its limitation in detecting one class of vulnerabilities known as inter-procedural vulnerabilities, where the to-be-patched statements and the vulnerability-triggering statements belong to different functions. For this purpose, we create the first Inter-Procedural Vulnerability Dataset (InterPVD) based on C/C++ open-source software, and we propose a tool dubbed VulTrigger for identifying vulnerability-triggering statements across functions. Experimental results show that VulTrigger can effectively identify vulnerability-triggering statements and inter-procedural vulnerabilities. Our findings include: (i) inter-procedural vulnerabilities are prevalent with an average of 2.8 inter-procedural layers;and (ii) function-level vulnerability detectors are much less effective in detecting to-be-patched functions of inter-procedural vulnerabilities than detecting their counterparts of intra-procedural vulnerabilities. Copyright © 2024, The Authors. All rights reserved.

关键词： Open source software

On the Effectiveness of Function-Level Vulnerability Detectors for Inter-Procedural Vulnerabilities

学校读者我要写书评

暂无评论

On the Effectiveness of Function-Level Vulnerability Detecto...

International Conference on Software Engineering (ICSE)

作者： Zhen Li Ning Wang Deqing Zou Yating Li Ruqian Zhang Shouhuai Xu Chao Zhang Hai Jin National Engineering Research Center for Big Data Technology and System Services Computing Technology and System Lab Hubei Key Laboratory of Distributed System Security Hubei Engineering Research Center on Big Data Security Cluster and Grid Computing Lab School of Cyber Science and Engineering Huazhong University of Science and Technology Wuhan China Jin YinHu Laboratory Wuhan China Department of Computer Science University of Colorado Colorado Springs Colorado Springs Colorado USA Institute for Network Sciences and Cyberspace Tsinghua University Beijing China School of Computer Science and Technology Huazhong University of Science and Technology Wuhan China

ISBN: (数字)9798400702174

ISBN: (纸本)9798350382143

Software vulnerabilities are a major cyber threat and it is important to detect them. One important approach to detecting vulnerabilities is to use deep learning while treating a program function as a whole, known as function-level vulnerability detectors. However, the limitation of this approach is not understood. In this paper, we investigate its limitation in detecting one class of vulnerabilities known as inter-procedural vulnerabilities, where the to-be-patched statements and the vulnerability-triggering statements belong to different functions. For this purpose, we create the first Inter -Procedural Vulnerability Dataset (InterPVD) based on C/C++ open-source software, and we propose a tool dubbed VulTrigger for identifying vulnerability-triggering statements across functions. Experimental results show that VulTrigger can effectively identify vulnerability-triggering statements and inter-procedural vulnerabilities. Our findings include: (i) inter-procedural vulnerabilities are prevalent with an average of 2.8 inter-procedural layers; and (ii) function-level vulner-ability detectors are much less effective in detecting to-be-patched functions of inter-procedural vulnerabilities than detecting their counterparts of intra-procedural vulnerabilities.

关键词： Deep learning Detectors Open source software Software engineering