This study addresses the challenge of diagnosing motor faults in long-tailed data distributions, characterized by dominant healthy states and rare fault types. We propose the LT-CVAE-GAN model, which integrates a Cond...
详细信息
This study addresses the challenge of diagnosing motor faults in long-tailed data distributions, characterized by dominant healthy states and rare fault types. We propose the LT-CVAE-GAN model, which integrates a conditional variational autoencoder (CVAE) with a conditional Generative Adversarial Network (CGAN) to enhance long-tailed fault diagnosis. Initially, we train the CVAE-GAN model using traditional CVAE and CGAN losses such as Kullback-Leibler (KL) divergence loss, reconstruction loss, and adversarial loss. Additionally, we introduce mean feature matching loss and pairwise feature matching loss to mitigate mode collapse and improve model stability, thereby enhancing the generation ability of less frequent fault samples under long-tail conditions. Subsequently, the pre-trained Generator is used to produce infrequent fault mode data to rebalance the dataset. Classifier parameters are fine-tuned in this step to improve fault diagnosis accuracy. Experimental results demonstrate that our LT-CVAE-GAN surpasses state-of-the-art models in diverse long-tailed conditions.
Mobility of autonomous vehicles is a challenging task to implement. Under the given traffic circumstances, all agent vehicles' behavior is to be understood and their paths for a short future needs to be predicted ...
详细信息
Mobility of autonomous vehicles is a challenging task to implement. Under the given traffic circumstances, all agent vehicles' behavior is to be understood and their paths for a short future needs to be predicted to decide upon the maneuver of the ego vehicle. We explore variationalautoencoder networks to get multimodal predictions of agents. In our work, we condition the network on past trajectories of agents and traffic scenes as well. The latent space representation of traffic scenes is achieved by using another variationalautoencoder network. The proposed networks are trained for varied prediction horizon. The performance of a network is compared with other networks trained on the dataset.
Ensemble learning using deep neural networks has become prevalent in predicting the Remaining Useful Life (RUL) of Lithium Batteries (LiBs). However, owing to the predominant linearity of ensemble learning, capturing ...
详细信息
Ensemble learning using deep neural networks has become prevalent in predicting the Remaining Useful Life (RUL) of Lithium Batteries (LiBs). However, owing to the predominant linearity of ensemble learning, capturing nonlinear relationships among base learners remains a persistent challenge. This study presents an RUL-prediction method for LiBs based on a neural-network ensemble via a conditional variational autoencoder (CVAE). The proposed method serves as a nonlinear ensemble learning method and promises enhanced prediction performance while maintaining ease of implementation. The methodology entails several key steps. First, data smoothing is conducted via local weighted linear regression. Subsequently, a preliminary linear-ensemble phase is executed through an attention mechanism, which filters out extraneous information in the features and bolsters the importance of valid features. Subsequently, a nonlinear ensemble is accomplished by utilizing the CVAE, with truth labels serving as conditions. Finally, the efficacy of the proposed method is substantiated through experimentation, demonstrating its superior performance compared to the candidate methods.
The challenges in multi-objective and multi-dimensional optimization design of airfoils, marked by prolonged optimization cycles and low accuracy, call for an efficient solution to expedite airfoil design. This study ...
详细信息
The challenges in multi-objective and multi-dimensional optimization design of airfoils, marked by prolonged optimization cycles and low accuracy, call for an efficient solution to expedite airfoil design. This study presents an innovative airfoil generative design model based on a conditional variational autoencoder (CVAE). Initially, to overcome the limitation of insufficient training data, the model leverages the variationalautoencoder (VAE) to learn the spatial distribution of University of Illinois at Urbana-Champaign (UIUC) airfoils, enabling the generation of a diverse set of airfoils with similar distributions. Subsequently, two CVAE-based airfoil generation models, the airfoil freedom design model and the airfoil precision design model, are proposed, which can realize diverse airfoil design under different conditions, such as shape and aerodynamic conditions. Furthermore, two measurements of roughness and diversity are introduced to evaluate the quality of the generated airfoils. The impact of different conditions and network parameters on the model's generation performance is thoroughly analyzed. Results indicate that our proposed model achieves a 65% lower error compared to physics-guided conditional Wasserstein generative adversarial networks (PG-cWGAN) when generating airfoils that satisfy a specific lift coefficient and a 99.99% lower error compared to airfoil pressure distributions generative adversarial networks (Airfoil-Cp-GAN) when generating airfoils that satisfy specific pressure distributions. This method introduces amore creative and accurate approach for aircraft designers in the realm of airfoil design. The code used for this paper is available at https://***/liujun39/airfoilvae.
In this article, we present a data-driven method for parametric models with noisy observation data. Gaussian process regression based reduced order modeling (GPRbased ROM) can realize fast online predictions without u...
详细信息
In this article, we present a data-driven method for parametric models with noisy observation data. Gaussian process regression based reduced order modeling (GPRbased ROM) can realize fast online predictions without using equations in the offline stage. However, GPR-based ROM does not perform well for complex systems since POD projection are naturally linear. conditional variational autoencoder (CVAE) can address this issue via nonlinear neural networks but it has more model complexity, which poses challenges for training and tuning hyperparameters. To this end, we propose a framework of CVAE with Gaussian process regression recognition (CVAEGPRR). The proposed method consists of a recognition model and a likelihood model. In the recognition model, we first extract low-dimensional features from data by POD to filter the redundant information with high frequency. And then a non-parametric model GPR is used to learn the map from parameters to POD latent variables, which can also alleviate the impact of noise. CVAE-GPRR can achieve the similar accuracy to CVAE but with fewer parameters. In the likelihood model, neural networks are used to reconstruct data. Besides the samples of POD latent variables and input parameters, physical variables are also added as the inputs to make predictions in the whole physical space. This cannot be achieved by either GPR-based ROM or CVAE. Moreover, the numerical results show that CVAE-GPRR may alleviate the overfitting issue in CVAE. (c) 2023 Published by Elsevier B.V.
Query expansion (QE) is commonly used to improve the performance of traditional information retrieval (IR) models. With the adoption of deep learning in IR research, neural QE models have emerged in recent years. Many...
详细信息
Query expansion (QE) is commonly used to improve the performance of traditional information retrieval (IR) models. With the adoption of deep learning in IR research, neural QE models have emerged in recent years. Many of these models focus on learning embeddings by leveraging query document relevance. These embedding models allow computing semantic similarities between queries and documents to generate expansion terms. However, existing models often ignore query-document interactions. This research aims to address that gap by proposing a QE model using a conditional variational autoencoder. It first maps a query-document pair into a latent space based on their interaction, then estimates an expansion model from that latent space. The proposed model is trained on relevance feedback data and generates expansions using pseudo relevance feedback at test time. The proposed model is evaluated on three standard TREC collections for document ranking: AP and Robust 04 and GOV02, and the MS MARCO dataset for passage ranking. Results show the model outperforms state-of-the-art traditional and neural QE models. It also demonstrates higher additivity with neural matching than baselines.
The class imbalance problem occurs when there is an unequal distribution of classes in a dataset and is a significant issue in various artificial intelligence applications. This study focuses on the severe multiclass ...
详细信息
The class imbalance problem occurs when there is an unequal distribution of classes in a dataset and is a significant issue in various artificial intelligence applications. This study focuses on the severe multiclass imbalance problem of human activity recognition in rehabilitation exercises for people with disabilities. To overcome this problem, we present a novel human action-centric augmentation method for human skeleton-based pose estimation. This study proposes the state transition-oriented conditional variational autoencoder (STO-CVAE) to capture action patterns in repeated exercises. The proposed approach generates action samples by capturing temporal information of human skeletons to improve the identification of minority disability classes. We conducted experimental studies with a real-world dataset gathered from rehabilitation exercises and confirmed the superiority and effectiveness of the proposed method. Specifically, all investigated classifiers (i.e., random forest, support vector machine, extreme gradient boosting, light gradient boosting machine, and TabNet) trained with the proposed augmentation method outperformed the models trained without augmentation in terms of the F1-score and accuracy, with F1-score showing the most improvement. Overall, the prediction accuracy of most classes was improved;in particular, the prediction accuracy of the minority classes was greatly improved. Hence, the proposed STO-CVAE can be used to improve the accuracy of disability classification in the field of physical medicine and rehabilitation and to provide suitable personal training and rehabilitation exercise programs.
BackgroundDeep learning (DL) has been widely used for diagnosis and prognosis prediction of numerous frequently occurring diseases. Generally, DL models require large datasets to perform accurate and reliable prognosi...
详细信息
BackgroundDeep learning (DL) has been widely used for diagnosis and prognosis prediction of numerous frequently occurring diseases. Generally, DL models require large datasets to perform accurate and reliable prognosis prediction and avoid overlearning. However, prognosis prediction of rare diseases is still limited owing to the small number of cases, resulting in small *** paper proposes a multimodal DL method to predict the prognosis of patients with malignant pleural mesothelioma (MPM) with a small number of 3D positron emission tomography-computed tomography (PET/CT) images and clinical *** 3D convolutional conditional variational autoencoder (3D-CCVAE), which adds a 3D-convolutional layer and conditional VAE to process 3D images, was used for dimensionality reduction of PET images. We developed a two-step model that performs dimensionality reduction using the 3D-CCVAE, which is resistant to overlearning. In the first step, clinical data were input to condition the model and perform dimensionality reduction of PET images, resulting in more efficient dimension reduction. In the second step, a subset of the dimensionally reduced features and clinical data were combined to predict 1-year survival of patients using the random forest classifier. To demonstrate the usefulness of the 3D-CCVAE, we created a model without the conditional mechanism (3D-CVAE), one without the variational mechanism (3D-CCAE), and one without an autoencoder (without AE), and compared their prediction results. We used PET images and clinical data of 520 patients with histologically proven MPM. The data were randomly split in a 2:1 ratio (train : test) and three-fold cross-validation was performed. The models were trained on the training set and evaluated based on the test set results. The area under the receiver operating characteristic curve (AUC) for all models was calculated using their 1-year survival predictions, and the results were *** obtained
In this paper, we propose a novel, model-free robust state estimator based on the conditional variational autoencoder (CVAE). Unlike traditional model-based methods such as weighted least squares, our approach elimina...
详细信息
ISBN:
(纸本)9798350381849;9798350381832
In this paper, we propose a novel, model-free robust state estimator based on the conditional variational autoencoder (CVAE). Unlike traditional model-based methods such as weighted least squares, our approach eliminates the need for prior knowledge of the power system model. Once adequately trained, our estimator can accurately estimate the system states based on measurements. As CVAE provides a probability distribution over the output data, the inherent uncertainty modeling makes the proposed estimator robust to bad data. The effectiveness and robustness of the proposed state estimator are demonstrated on the IEEE 14-bus system.
Resampling is the most commonly used method for dealing with imbalanced data, in addition to modifying the algorithm mechanism, it can, for example, generate new minority samples or reduce majority samples to adjust t...
详细信息
Resampling is the most commonly used method for dealing with imbalanced data, in addition to modifying the algorithm mechanism, it can, for example, generate new minority samples or reduce majority samples to adjust the data distribution. However, to date, related research has predominantly focused on solving the classification problem, while the issue of imbalanced regression data has rarely been discussed. In real-world applications, predicting regression data is a common and valuable issue in decision making, especially in regard to those rare samples with extremely high or low values, such as those encountered in the fields of signal processing, finance, or meteorology. This study therefore divided its regression data into rare samples and normal samples, with self-defined relevance functions and, in addition, proposed a boosting resampling method based on a conditional variational autoencoder. The experimental results showed that when using the proposed resampling method was employed, the prediction performance of the whole testing data set was slightly increased, while the performance for the rare samples was significantly improved. (C) 2022 Elsevier Inc. All rights reserved.
暂无评论