检索结果-内蒙古大学图书馆

Interspeech Conference

作者： Ding, Shaojin Gutierrez-Osuna, Ricardo Texas A&M Univ Dept Comp Sci & Engn College Stn TX 77843 USA

This paper proposes a Group Latent Embedding for Vector Quantized variational autoencoders (VQ-VAE) used in non-parallel Voice Conversion (VC). Previous studies have shown that VQ-VAE can generate high-quality VC syntheses when it is paired with a powerful decoder. However, in a conventional VQ-VAE, adjacent atoms in the embedding dictionary can represent entirely different phonetic content. Therefore, the VC syntheses can have mispronunciations and distortions whenever the output of the encoder is quantized to an atom representing entirely different phonetic content. To address this issue, we propose an approach that divides the embedding dictionary into groups and uses the weighted average of atoms in the nearest group as the latent embedding. We conducted both objective and subjective experiments on the non-parallel CSTR VCTK corpus. Results show that the proposed approach significantly improves the acoustic quality of the VC syntheses compared to the traditional VQ-VAE (13.7% relative improvement) while retaining the voice identity of the target speaker.

关键词： non-parallel voice conversion variational autoencoder group latent embedding

来源：评论

学校读者我要写书评

暂无评论

Jointly Trained variational autoencoder for Multi-Modal Sensor Fusion 22

Jointly Trained Variational Autoencoder for Multi-Modal Sens...

引用

22nd International Conference on Information Fusion (FUSION)

作者： Korthals, Timo Hesse, Marc Leitner, Juergen Melnik, Andrew Rueckert, Ulrich Bielefeld Univ Cognitron & Sensor Syst Bielefeld Germany Queensland Univ Technol Australian Ctr Robot Vis Brisbane Qld Australia Bielefeld Univ Neuroinformat Grp Bielefeld Germany

ISBN: (纸本)9780996452786

This work presents the novel multi-modal variational autoencoder approach M(2)VAE which is derived from the complete marginal joint log-likelihood. This allows the end-to-end training of Bayesian information fusion on raw data for all subsets of a sensor setup. Furthermore, we introduce the concept of in-place fusion applicable to distributed sensing where latent embeddings of observations need to be fused with new data. To facilitate in-place fusion even on raw data, we introduced the concept of a re-encoding loss that stabilizes the decoding and makes visualization of latent statistics possible. We also show that the M(2)VAE finds a coherent latent embedding, such that a single nave Bayes classifier performs equally well on all permutations of a bi-modal Mixture-of-Gaussians signal. Finally, we show that our approach outperforms current VAE approaches on a bi-modal MNIST & fashion-MNIST data set and works sufficiently well as a preprocessing on a tri-modal simulated camera & LiDAR data set from the Gazebo simulator.

关键词： Multi-Modal Fusion Deep Generative Model variational autoencoder

来源：评论

学校读者我要写书评

暂无评论

CONTINUAL LEARNING FOR ANOMALY DETECTION WITH variational autoencoder 44

CONTINUAL LEARNING FOR ANOMALY DETECTION WITH VARIATIONAL AU...

引用

44th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

作者： Wiewel, Felix Yang, Bin Univ Stuttgart Inst Signal Proc & Syst Theory Stuttgart Germany

ISBN: (纸本)9781479981311

Detecting anomalies using a variational autoencoder (VAE) suffers from catastrophic forgetting when trained on a continually growing set of normal data where only the most recently added data is available. Solving this problem would allow the use of the VAE for anomaly detection in settings where it is difficult or even impossible to retain all normal data at the same time. We propose an efficient extension of a method for continual learning which alleviates catastrophic forgetting for anomaly detection using a VAE. We show on some anomaly detection problems that the definition of normal data can be continually expanded without requiring all previously seen data.

关键词： Continual Learning Anomaly Detection variational autoencoder Generative Replay

来源：评论

学校读者我要写书评

暂无评论

Improving Performance in Software Defect Prediction Using variational autoencoder 5

Improving Performance in Software Defect Prediction Using Va...

引用

IEEE 5th Conference on Knowledge Based Engineering and Innovation (KBEI)

作者： Eivazpour, Z. Keyvanpour, Mohammad Reza Alzahra Univ Dept Comp Engn Tehran Iran Alzahra Univ Data Min Lab Tehran Iran

ISBN: (纸本)9781728108728

Software defect prediction (SDP) is a beneficial task to save limited resources in the software testing stage for improving software quality. However, the imbalanced distribution in defect datasets could be a challenge for often machine learning algorithms, an effect on the performance of the algorithms. To overcome this issue, oversampling techniques from the minority class has been adopted. In this work, we suggest a new oversampling method, which trained a variational autoencoder (VAE) to generate synthesized samples aimed for output mimicked minority samples that were then combined with training dataset into an augmented training dataset. In the experiments, we explored ten SDP datasets from the PROMISE freely accessible repository. We measured the performance of the proposed method by comparing it with state-of-the-art oversampling techniques including Random Over-Sampling, SMOTE, Borderline-SMOTE, and ADASYN. Based on the investigation results, the proposed method provides better mean performance of SDP models between all examined techniques.

关键词： Software Defect Prediction variational autoencoder Class Imbalance Over-sampling

来源：评论

学校读者我要写书评

暂无评论

Detecting Anomalies in Longitudinal Elevation of Track Geometry Using Train Dynamic Responses via a variational autoencoder

Detecting Anomalies in Longitudinal Elevation of Track Geome...

引用

Conference on Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems

作者： Liu, Jingxiao Wei, Yujie Berges, Mario Bielak, Jacobo Garrett, James H. Noh, Hae Young Carnegie Mellon Univ Dept Civil & Environm Engn 5000 Forbes Ave Pittsburgh PA 15213 USA

ISBN: (纸本)9781510625969

Track geometry is one of the most important health indices in the maintenance of rail tracks. Visual inspection and inspection using a track-geometry car are two common approaches to inspect track geometry. Presently, using accelerations from in-service trains has become a popular track inspection approach, because it is a low-cost way to monitor the rail tracks more frequently. However, due to the noise presented in the collected accelerations, detecting anomalies using manually designed features often results in many false alarms. In this paper, we propose a learning-based anomaly detection approach for monitoring the longitude elevation of track geometry from the dynamic response of an in-service train. We consider the track geometry with a sudden change as an anomaly, measured by the signal energy of slopes of the track geometry. The proposed approach uses a variational autoencoder (VAE) to detect the anomaly. The VAE takes accelerations as input and learns a mapping from the frequency-domain representation of acceleration signals to a low-dimensional latent space that represents the distribution of the observed data. The reconstruction probability, which measures the variability of the distribution of the input data, is used as an anomaly score for indicating how well the input follows the normal pattern. Compared to distance- and density-based anomaly detection methods, such as K-nearest neighbor and clustering, the VAE-based anomaly detection is robust to measurement noise and prevents overfitting because it captures the underlying distribution of the data in a low-dimensional space. Furthermore, the VAE-based method does not require model-specific thresholds for detecting anomalies because it uses a probabilistic measurement instead of reconstruction error as the anomaly score. We validate the proposed VAE-based approach on the vibration dataset from an in-service train. We show that this approach outperforms a baseline model (an autoencoder-based anomaly de

关键词： Anomaly detection track geometry inspection indirect structural health monitoring variational autoencoder

来源：评论

学校读者我要写书评

暂无评论

Joint Chord and Key Estimation Based on a Hierarchical variational autoencoder with Multi-task Learning

引用

APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING 2022年第1期11卷

作者： Wu, Yiming Yoshii, Kazuyoshi Kyoto Univ Grad Sch Informat Kyoto Japan Japan Sci & Technol Agcy PRESTO Tokyo Japan

This paper describes a deep generative approach to joint chord and key estimation for music signals. The limited amount of music signals with complete annotations has been the major bottleneck in supervised multi-task learning of a classification model. To overcome this limitation, we integrate the supervised multi-task learning approach with the unsupervised autoencoding approach in a mutually complementary manner. Considering the typical process of music composition, we formulate a hierarchical latent variable model that sequentially generates keys, chords, and chroma vectors. The keys and chords are assumed to follow a language model that represents their relationships and dynamics. In the framework of amortized variational inference (AVI), we introduce a classification model that jointly infers discrete chord and key labels and a recognition model that infers continuous latent features. These models are combined to form a variational autoencoder (VAE) and are trained jointly in a (semi-)supervised manner, where the generative and language models act as regularizers for the classification model. We comprehensively investigate three different architectures for the chord and key classification model, and three different architectures for the language model. Experimental results demonstrate that the VAE-based multi-task learning improves chord estimation as well as key estimation.

关键词： Automatic chord estimation automatic key estimation variational autoencoder multi-task learning

来源：评论

学校读者我要写书评

暂无评论

Designing Novel Functional Peptides by Manipulating a Temperature in the Softmax Function Coupled with variational autoencoder

Designing Novel Functional Peptides by Manipulating a Temper...

引用

IEEE International Conference on Big Data (Big Data)

作者： Chen, Shuan Kim, Hyun Uk Korea Adv Inst Sci & Technol KAIST Dept Chem & Biomol Engn Daejeon South Korea Korea Adv Inst Sci & Technol KAIST Dept Chem & Biomol Engn KAIST Inst Artificial Intelligence Daejeon South Korea

ISBN: (纸本)9781728108582

Development of an efficient peptide design method is crucial for tackling medical problems, such as designing antimicrobial peptides for combating drug resistant pathogens and anticancer peptides for various cancers. Here, we present variational autoencoder (VAE) coupled with a Softmax function having a temperature factor (1) for high-throughput design of novel functional peptides. VAE is a generative machine learning model, which has proved to be useful for generating peptide sequences. In this study, we additionally use a Softmax function with T to facilitate determining the most probable amino acids at each position of peptide sequences to be generated, which is difficult to achieve using a conventional VAE. In particular, by manipulating T in the Softmax function, we select biologically most feasible peptides with a desired function. This method is demonstrated for designing novel antimicrobial and anticancer peptides in this study. The method presented herein should be useful for designing various peptides with a desired function upon availability of relevant datasets.

关键词： peptide design Softmax function with a temperature factor variational autoencoder

来源：评论

学校读者我要写书评

暂无评论

Facial Image Inpainting with variational autoencoder

Facial Image Inpainting with Variational Autoencoder

引用

2nd International Conference of Intelligent Robotic and Control Engineering (IRCE)

作者： Tu, Ching-Ting Chen, Yi-Fu Natl Chung Hsing Univ Dept Appl Math Taichung 402 Taiwan Tamkang Univ Dept Comp Sci & Informat Engn New Taipei Taiwan

ISBN: (纸本)9781728141923

This paper proposed a learning-based approach to reveal diversity possible appearances under the missing area of an occluded unseen image. In general, there are a lot of possible facial appearances for the missing area;for example, a male with a scarf, it is difficult to predict he has a beard in the covered area or not? In this paper, we propose a novel method for facial image inpainting, which generates the missing facial appearance by conditioning on the observable appearance. Given a trained standard variational autoencoder (VAE) for un-occluded face generation. To be specified, we search for the possible set of VAE coding vector for the current occluded input image, and the predicted coding should be robust to the missing area. The possible facial appearance set is then recovered through the decoder of VAE model. Experiments show that our method successfully predicts recovered results in large missing regions;these results are diverse, and all are reasonable to be consistent with the observable facial area, i.e., both the facial geometry and the personal characteristics are preserved.

关键词： image inpainting variational autoencoder sampling

来源：评论

学校读者我要写书评

暂无评论

ANOMALY DETECTION USING A variational autoencoder NEURAL NETWORK WITH A NOVEL OBJECTIVE FUNCTION AND GAUSSIAN MIXTURE MODEL SELECTION TECHNIQUE

ANOMALY DETECTION USING A VARIATIONAL AUTOENCODER NEURAL NET...

引用

作者： Bowman, Brandon Naval Postgraduate School

学位级别：硕士

Anomalies in data often convey critical information that can be leveraged in a variety of applications. For the military engaged in combat, this can amount to identifying threats early and preserving a lethal edge over an adversary. In other more benign cases it can corrupt data integrity and lead to ineffective application of other data analysis techniques. To tackle the problem of anomaly detection, there are several common methods provided in statistics and machine learning literature, including variational autoencoders (VAEs). Using a VAE, we develop a novel objective function to improve its performance detecting anomalies. Additionally, we introduce a modeling pipeline that works in the fully unsupervised context, where one does not know the true proportion of anomalies present in the data. To construct this pipeline, we fit reconstruction errors using a Gaussian mixture model (GMM) and select the model whose characteristics best match our performance metrics. Using our approach, we observe an increase in anomalies detected against a standard objective function, and we measure an average improvement of 0.4021 in F1 scores. We show our findings using four labeled benchmark data sets and apply our conclusions on an open-source, unlabeled data set taken from ***.

关键词： anomaly detection neural networks variational autoencoder Gaussian mixture model

来源：评论

学校读者我要写书评

暂无评论

Connections with Robust PCA and the Role of Emergent Sparsity in variational autoencoder Models

引用

JOURNAL OF MACHINE LEARNING RESEARCH 2018年第1期19卷 1573-1614页

作者： Dai, Bin Wang, Yu Aston, John Hua, Gang Wipf, David Tsinghua Univ Inst Adv Study Beijing Peoples R China Univ Cambridge Dept Pure Math & Math Stat Cambridge England Microsoft Res Redmond WA USA Microsoft Res Beijing Peoples R China

variational autoencoders (VAE) represent a popular, flexible form of deep generative model that can be stochastically fit to samples from a given random process using an information-theoretic variational bound on the true underlying distribution. Once so-obtained, the model can be putatively used to generate new samples from this distribution, or to provide a low-dimensional latent representation of existing samples. While quite effective in numerous application domains, certain important mechanisms which govern the behavior of the VAE are obfuscated by the intractable integrals and resulting stochastic approximations involved. Moreover, as a highly non-convex model, it remains unclear exactly how minima of the underlying energy relate to original design purposes. We attempt to better quantify these issues by analyzing a series of tractable special cases of increasing complexity. In doing so, we unveil interesting connections with more traditional dimensionality reduction models, as well as an intrinsic yet underappreciated propensity for robustly dismissing sparse outliers when estimating latent manifolds. With respect to the latter, we demonstrate that the VAE can be viewed as the natural evolution of recent robust PCA models, capable of learning nonlinear manifolds of unknown dimension obscured by gross corruptions.

关键词： variational autoencoder Deep Generative Model Robust PCA

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：