To facilitate effective assessment of loads (e.g., temperature and stress) and life management of high-pressure turbine (HPT) blades, a wasserstein autoencoder (WAE)-enhanced thermodynamically coupled reduced-order mo...
详细信息
To facilitate effective assessment of loads (e.g., temperature and stress) and life management of high-pressure turbine (HPT) blades, a wasserstein autoencoder (WAE)-enhanced thermodynamically coupled reduced-order model (ROM) is proposed in this paper. The advanced ROM for the nonlinear thermomechanical coupling fields is developed by introducing the deep learning model of WAE in the proper orthogonal decomposition (POD) method. The proposed method improves the prediction accuracy of loads in locally focused regions and generalization performance. The accuracy and efficiency of this method are validated through 30 sets of validation conditions. Results indicate that the proposed approach achieves higher accuracy and better generalization performance than traditional POD-based methods, with errors maintained within 10. Additionally, computational speed is improved by nearly 1400 times compared to conventional numerical methods. The WAE-enhanced ROM is applied for load and life assessment of the HPT blades throughout their service life. The evaluation time for a single aeroengine performance parameter is 1.7 s, and for a single flight evaluation, it is 67 s, which highlights the effectiveness of the proposed method in enabling the assessment of the loads and remaining life of HPT blades.
We propose a wasserstein autoencoder based end-to-end geometric shaping scheme for IM/DD OAM-MDM optical fiber communication system. Compared with traditional autoencoder, the BER decreased by up to 28% and 33% with t...
详细信息
In the development of targeted drugs, anticancer peptides (ACPs) have attracted great attention because of their high selectivity, low toxicity and minimal non-specificity. In this work, we report a framework of ACPs ...
详细信息
In the development of targeted drugs, anticancer peptides (ACPs) have attracted great attention because of their high selectivity, low toxicity and minimal non-specificity. In this work, we report a framework of ACPs generation, which combines wasserstein autoencoder (WAE) generative model and Particle Swarm Optimization (PSO) forward search algorithm guided by attribute predictive model to generate ACPs with desired properties. It is well known that generative models based on Variational autoencoder (VAE) and Generative Adversarial Networks (GAN) are difficult to be used for de novo design due to the problems of posterior collapse and difficult convergence of training. Our WAE-based generative model trains more successfully (lower perplexity and reconstruction loss) than both VAE and GAN-based generative models, and the semantic connections in the latent space of WAE accelerate the process of forward controlled generation of PSO, while VAE fails to capture this feature. Finally, we validated our pipeline on breast cancer targets (HIF-1) and lung cancer targets (VEGR, ErbB2), respectively. By peptide-protein docking, we found candidate compounds with the same binding sites as the peptides carried in the crystal structure but with higher binding affinity and novel structures, which may be potent antagonists that interfere with these target-mediated signaling.
We propose a highly generative dehazing method based on pixel-wise wasserstein autoencoders. In contrast to existing dehazing methods based on generative adversarial networks, our method can produce a variety of dehaz...
详细信息
We propose a highly generative dehazing method based on pixel-wise wasserstein autoencoders. In contrast to existing dehazing methods based on generative adversarial networks, our method can produce a variety of dehazed images with different styles. It significantly improves the dehazing accuracy via pixel-wise matching from hazy to dehazed images through 2-dimensional latent tensors of the wasserstein autoencoder. In addition, we present an advanced feature fusion technique to deliver rich information to the latent space. For style transfer, we introduce a mapping function that transforms existing latent spaces to new ones. Thus, our method can produce highly generative haze-free images with various tones, illuminations, and moods, which induces several interesting applications, including low-light enhancement, daytime dehazing, nighttime dehazing, and underwater image enhancement. Experimental results demonstrate that our method quantitatively outperforms existing state-of-the-art methods for synthetic and real-world datasets, and simultaneously generates highly generative haze-free images, which are qualitatively diverse.
Disentangled representation learning has undoubtedly benefited from objective function surgery. However, a delicate balancing act of tuning is still required in order to trade off reconstruction fidelity versus disent...
详细信息
ISBN:
(数字)9783030865238
ISBN:
(纸本)9783030865238;9783030865221
Disentangled representation learning has undoubtedly benefited from objective function surgery. However, a delicate balancing act of tuning is still required in order to trade off reconstruction fidelity versus disentanglement. Building on previous successes of penalizing the total correlation in the latent variables, we propose TCWAE (Total Correlation wasserstein autoencoder). Working in the WAE paradigm naturally enables the separation of the total-correlation term, thus providing disentanglement control over the learned representation, while offering more flexibility in the choice of reconstruction cost. We propose two variants using different KL estimators and analyse in turn the impact of having different ground cost functions and latent regularization terms. Extensive quantitative comparisons on data sets with known generative factors shows that our methods present competitive results relative to state-of-the-art techniques. We further study the trade off between disentanglement and reconstruction on more-difficult data sets with unknown generative factors, where the flexibility of the WAE paradigm leads to improved reconstructions.
Recommender systems for implicit data, e.g., browsing data, have attracted more and more research efforts. Most existing approaches assume the implicit data is i.i.d. which ignores the fact that the real-world data is...
详细信息
ISBN:
(纸本)9781665419246
Recommender systems for implicit data, e.g., browsing data, have attracted more and more research efforts. Most existing approaches assume the implicit data is i.i.d. which ignores the fact that the real-world data is generally correlated with each other. To cope with this issue, this paper proposes the correlated wasserstein autoencoders (CWAEs) model to capture data correlation to enhance recommendation peformance. Particularly in the proposed approach, we first formulate correlated data via an undirected acyclic graph and then generalize the undirected acyclic graph to an acyclic graph by averaging all its' maximum acyclic subgraphs. To further enhance model performance, we introduce negative sampling strategy. Experiments are evaluated on Epinions dataset. The widely adopted evaluation criteria, i.e., CRR and NCRR, are adopted to evaluate both baseline models and our proposed approach. Experimental results have demonstrated the superiority of the proposed models.
Tabular data generation is a complex task due to its distinctive characteristics and inherent complexities. While Variational autoencoders have been adapted from the computer vision domain for tabular data synthesis, ...
详细信息
Tabular data generation is a complex task due to its distinctive characteristics and inherent complexities. While Variational autoencoders have been adapted from the computer vision domain for tabular data synthesis, their reliance on non-deterministic latent space regularization introduces limitations. The stochastic nature of Variational autoencoders can contribute to collapsed posteriors, yielding suboptimal outcomes and limiting control over the latent space. This characteristic also constrains the exploration of latent space interpolation. To address these challenges, we present the Tabular wasserstein autoencoder (TWAE), leveraging the deterministic encoding mechanism of wasserstein autoencoders. This characteristic facilitates a deterministic mapping of inputs to latent codes, enhancing the stability and expressiveness of our model's latent space. This, in turn, enables seamless integration with shallow interpolation mechanisms like the synthetic minority over-sampling technique (SMOTE) within the data generation process via deep learning. Specifically, TWAE is trained once to establish a low-dimensional representation of real data, and various latent interpolation methods efficiently generate synthetic latent points, achieving a balance between accuracy and efficiency. Extensive experiments consistently demonstrate TWAE's superiority, showcasing its versatility across diverse feature types and dataset sizes. This innovative approach, combining WAE principles with shallow interpolation, effectively leverages SMOTE's advantages, establishing TWAE as a robust solution for complex tabular data synthesis.
The recommender systems have long been studied in the literature. The collaborative filtering is one of the most widely adopted recommendation techniques which is usually applied to the explicit data, e.g., rating sco...
详细信息
The recommender systems have long been studied in the literature. The collaborative filtering is one of the most widely adopted recommendation techniques which is usually applied to the explicit data, e.g., rating scores. However, the implicit data, e.g., click data, is believed to be able to discover user's latent preferences. Consequently, a number of research attempts have been made toward this issue. To the best of our knowledge, this paper is the first attempt to adapt the wasserstein autoencoders to collaborative filtering problem. Particularly, we propose a new loss function by introducing an L-1 regularization term to learn a sparse low-rank representation form to represent latent variables. Then, we carefully design (1) a new cost function to minimize the data reconstruction error, and (2) the appropriate distance metrics for the calculation of KL divergence between the learned distribution of latent variables and the underlying true data distribution. Rigorous experiments are performed on three widely adopted datasets. Both the state-of-the-art approaches, e.g., Mult-VAE and Mult-DAE, and the baseline models are evaluated on these datasets. The promising experimental results demonstrate that the proposed approach is superior to the compared approaches with respect to evaluation criteria Recall@R and NDCG@R.
Probabilistic autoencoders are effective for text generation. However, they are unable to control the style of generated text, despite the training samples explicitly labeled with different styles. We present a Wasser...
详细信息
ISBN:
(纸本)9783030835262;9783030835279
Probabilistic autoencoders are effective for text generation. However, they are unable to control the style of generated text, despite the training samples explicitly labeled with different styles. We present a wasserstein autoencoder with a Gaussian mixture prior for style-aware sentence generation. Our model is trained on a multi-class dataset and generates sentences in the style of the desired class. It is also capable of interpolating multiple classes. Moreover, we can train our model on relatively small datasets. While a regular WAE or VAE cannot generate diverse sentences with few training samples, our approach generates diverse sentences and preserves the style of the desired classes.
作者:
Liu, YanyanGong, ZhiguoUniv Macau
State Key Lab Internet Things Smart City Macau 999078 Peoples R China Univ Macau
Guangdong Macau Joint Lab Adv & Intelligent Comp Macau 999078 Peoples R China Univ Macau
Dept Comp & Informat Sci Macau 999078 Peoples R China
Topic models aim to discover a set of latent topics in a textual corpus. Graph Neural Networks (GNNs) have been recently utilized in Neural Topic Models (NTMs) due to their strong capacity to model document representa...
详细信息
Topic models aim to discover a set of latent topics in a textual corpus. Graph Neural Networks (GNNs) have been recently utilized in Neural Topic Models (NTMs) due to their strong capacity to model document representations with the text graph. Most of the previous works construct the text graph by considering documents and words as nodes and document embeddings are learned through the topology structure of the text graph. However, while conducting graph learning on topic modeling, sorely considering document- word propagation will lose the guidance of topic relevance and the graph propagation cannot reflect the true relationship at the topic level which will result in inaccurate topic extraction. To address the above-mentioned issue, we propose a novel neural topic model based on Cycling Topic Graph Learning (CyTGL). Specifically, we design a novel three-party topic graph for document-topic-word to incorporate topic propagation into graph-based topic models. In the three-party topic graph, the topic layer is latent and we recursively extract the topic layer through the learning process. Leveraging this topic graph, we employ topic attention message passing to propagate topical information to enhance the document representations. What is more, the topic layer in the three-party graph can be regarded as the prior knowledge that offers guidance for the process of topic extraction. Crucially, the hierarchical relationships in the three-party graph are maintained during the learning process. We conduct experiments on several widely used datasets and the results show our proposed approach outperforms state-of-the-art topic models.
暂无评论