Zero-shot learning recognizes the unseen samples via the model learned from the seen class samples and semantic features. Due to the lack of information of unseen class samples in the training set, some researchers ha...
详细信息
Zero-shot learning recognizes the unseen samples via the model learned from the seen class samples and semantic features. Due to the lack of information of unseen class samples in the training set, some researchers have proposed the method of generating unseen class samples by using generative models. However, the generated model is trained with the training set samples first, and then the unseen class samples are generated, which results in the features of the unseen class samples tending to be biased toward the seen class and may produce large deviations from the real unseen class samples. To tackle this problem, we use the autoencoder method to generate the unseen class samples and combine the semantic features of the unseen classes with the proposed new sample features to construct the loss function. The proposed method is validated on three datasets and showed good results.
X-ray diffraction (XRD) is commonly used to analyze systematic variations occurring in compounds to tune their material properties. Machine learning can be used to extract such significant systematics among a series o...
详细信息
X-ray diffraction (XRD) is commonly used to analyze systematic variations occurring in compounds to tune their material properties. Machine learning can be used to extract such significant systematics among a series of observed peak patterns. The feature space concept, in the context of autoencoders, can be the platform for performing such extractions, where each peak pattern is projected into a space to extract the systematics. Herein, an autoencoder is trained to learn to detect the systematics driven by atomic substitutions within a single phase without structural transitions. The feature space constructed by the trained autoencoder classifies the substitution compositions of XRD patterns satisfactorily. The compositions interpolated in the feature space are in good agreement with those of an XRD pattern projected to a point. Subsequently, the autoencoder generates a virtual XRD pattern from an interpolated point in the feature space. When the feature space is effectively optimized by enough training data, the autoencoder predicts an XRD pattern with a concentration, which is difficult to be described using the possible resolution of the supercell method of ab initio calculations.
After the development of next-generation sequencing techniques, protein sequences are abundantly available. Determining the functional characteristics of these proteins is costly and time-consuming. The gap between th...
详细信息
After the development of next-generation sequencing techniques, protein sequences are abundantly available. Determining the functional characteristics of these proteins is costly and time-consuming. The gap between the number of protein sequences and their corresponding functions is continuously increasing. Advanced machine-learning methods have stepped up to fill this gap. In this work, an advanced deep-learning-based approach is proposed for protein function prediction using protein sequences. A set of autoencoders is trained in a semi-supervised manner with protein sequences. Each autoencoder corresponds to a single protein function only. In particular, 932 autoencoders corresponding to 932 biological processes and 585 autoencoders corresponding to 585 molecular functions are trained separately. Reconstruction losses of each protein sample for every autoencoder are used as a feature to classify these sequences into their corresponding functions. The proposed model is tested on test protein samples and achieves promising results. This method can be easily extended to predict any number of functions having an ample amount of supporting protein sequences. All relevant codes, data and trained models are available at https://***/richadhanuka/PFP-autoencoders.
The efficient management of urban water distribution networks is crucial for public health and urban development. One of the major challenges is the quick and accurate detection of leaks, which can lead to water loss,...
详细信息
The efficient management of urban water distribution networks is crucial for public health and urban development. One of the major challenges is the quick and accurate detection of leaks, which can lead to water loss, infrastructure damage, and environmental hazards. Many existing leak detection methods are ineffective, especially in complex and aging pipeline networks. If these limitations are not overcome, it can result in a chain of infrastructure failures, exacerbating damage, increasing repair costs, and causing water shortages and public health risks. The leak issue is further complicated by increasing urban water demand, climate change, and population growth. Therefore, there is an urgent need for intelligent systems that can overcome the limitations of traditional methodologies and leverage sophisticated data analysis and machine learning technologies. In this study, we propose a reliable and advanced method for detecting leaks in water pipes using a framework based on Long Short-Term Memory (LSTM) networks combined with autoencoders. The framework is designed to manage the temporal dimension of time-series data and is enhanced with ensemble learning techniques, making it sensitive to subtle signals indicating leaks while robustly dealing with noise signals. Through the integration of signal processing and pattern recognition, the machine learning-based model addresses the leak detection problem, providing an intelligent system that enhances environmental protection and resource management. The proposed approach greatly enhances the accuracy and precision of leak detection, making essential contributions in the field and offering promising prospects for the future of sustainable water management strategies.
The autoencoder (AE) is a fundamental deep learning approach to anomaly detection. AEs are trained on the assumption that abnormal inputs will produce higher reconstruction errors than normal ones. In practice, howeve...
详细信息
The autoencoder (AE) is a fundamental deep learning approach to anomaly detection. AEs are trained on the assumption that abnormal inputs will produce higher reconstruction errors than normal ones. In practice, however, this assumption is unreliable in the unsupervised case, where the training data may contain anomalous examples. Given sufficient capacity and training time, an AE can generalize to such an extent that it reliably reconstructs anomalies. Consequently, the ability to distinguish anomalies via reconstruction errors is diminished. We respond to this limitation by introducing three new methods to more reliably train AEs for unsupervised anomaly detection: cumulative error scoring (CES), percentile loss (PL), and early stopping via knee detection. We demonstrate significant improvements over conventional AE training on image, remote-sensing, and cybersecurity datasets.
Safety, efficiency, and reliability are essential requirements for aero-engines. Timely and accurate diagnosis of engine faults enables effective planning of maintenance operations and reduces downtime. Although tradi...
详细信息
Safety, efficiency, and reliability are essential requirements for aero-engines. Timely and accurate diagnosis of engine faults enables effective planning of maintenance operations and reduces downtime. Although traditional physics-based methods perform well under controlled test bench scenarios, their effectiveness in handling very noisy data and missing values is limited, constraining their utility in real-world settings. To address these gaps, we propose a fusion autoencoder that combines physics-informed and pattern-informed techniques, augmented with a Beta-Variational autoencoder learning backbone to enhance the robustness of the model. Additionally, a novel health index called the piecewise anomaly index is proposed that can detect and classify faults simultaneously. To evaluate the efficacy of the novel framework, we modified the New Commercial Modular Aero-Propulsion System Simulation (N-CMAPSS) dataset to simulate real-world scenarios and conducted experiments. The results show that the proposed method can detect faults earlier than common techniques, while also achieving accurate fault classification and degree determination with the new index.
Binary hashing is an effective approach for content-based image retrieval, and learning binary codes with neural networks has attracted increasing attention in recent years. However, the training of hashing neural net...
详细信息
Binary hashing is an effective approach for content-based image retrieval, and learning binary codes with neural networks has attracted increasing attention in recent years. However, the training of hashing neural networks is difficult due to the binary constraint on hash codes. In addition, neural networks are easily affected by input data with small perturbations. Therefore, a sensitive binary hashing autoencoder (SBHA) is proposed to handle these challenges by introducing stochastic sensitivity for image retrieval. SBHA extracts meaningful features from original inputs and maps them onto a binary space to obtain binary hash codes directly. Different from ordinary autoencoders, SBHA is trained by minimizing the reconstruction error, the stochastic sensitive error, and the binary constraint error simultaneously. SBHA reduces output sensitivity to unseen samples with small perturbations from training samples by minimizing the stochastic sensitive error, which helps to learn more robust features. Moreover, SBHA is trained with a binary constraint and outputs binary codes directly. To tackle the difficulty of optimization with the binary constraint, we train the SBHA with alternating optimization. Experimental results on three benchmark datasets show that SBHA is competitive and significantly outperforms state-of-the-art methods for binary hashing.
Depth map estimation from a single RGB image is a fundamental computer vision and image processing task for various applications. Deep learning based depth map estimation has improved prediction accuracy compared with...
详细信息
Depth map estimation from a single RGB image is a fundamental computer vision and image processing task for various applications. Deep learning based depth map estimation has improved prediction accuracy compared with traditional approaches by learning huge numbers of RGB-D images, but challenging issues remain for distorted and blurry reconstruction in object boundaries because the features are not enforced during training. This paper presents a multi-view attention autoencoder embedded in a deep neural network to emphasize self-representative features, which provide robust depth maps by simultaneously accentuating useful features and reducing redundant features to improve depth map estimation performance. Qualitative and quantitative experiments were conducted to verify the proposed network effectiveness, which can be utilized for three-dimensional scene reconstruction and understanding.
Despite its great success,deep learning severely suffers from robustness;i.e.,deep neural networks are very vulnerable to adversarial attacks,even the simplest *** by recent advances in brain science,we propose the de...
详细信息
Despite its great success,deep learning severely suffers from robustness;i.e.,deep neural networks are very vulnerable to adversarial attacks,even the simplest *** by recent advances in brain science,we propose the denoised internal models(DIM),a novel generative autoencoder-based model to tackle this *** the pipeline in the human brain for visual signal processing,DIM adopts a two-stage *** the first stage,DIM uses a denoiser to reduce the noise and the dimensions of inputs,reflecting the information pre-processing in the *** by the sparse coding of memory-related traces in the primary visual cortex,the second stage produces a set of internal models,one for each *** evaluate DIM over 42 adversarial attacks,showing that DIM effectively defenses against all the attacks and outperforms the SOTA on the overall robustness on the MNIST(Modified National Institute of Standards and Technology)dataset.
In recent years, the proliferation of IoT technologies and the widespread adoption of wireless sensors across various critical infrastructures such as power plants, service monitoring systems, space and earth explorat...
详细信息
In recent years, the proliferation of IoT technologies and the widespread adoption of wireless sensors across various critical infrastructures such as power plants, service monitoring systems, space and earth exploration missions, and water treatment facilities have resulted in the generation of vast quantities of multivariate time series data. Within this context, unsupervised anomaly detection has emerged as a pivotal yet challenging problem in time series research, necessitating machine learning models capable of identifying rare anomalies amidst massive datasets. Traditionally, unsupervised methods have approached this issue by learning representations of primary patterns within sequences and detecting deviations through reconstruction errors. However, the effectiveness of this approach is often limited due to the intricate dynamics and diverse patterns inherent in these dynamic systems. Moreover, many existing unsupervised anomaly detection techniques fail to fully exploit inter-feature relationships within multivariate time series data, thereby overlooking a crucial criterion for accurate detection. To address these shortcomings, this paper introduces a novel unsupervised method for multivariate time series anomaly detection based on normalized flows and autoencoders. Central to our approach is the incorporation of a channel shuffling mechanism during training, enhancing the model's capacity to discern inter-channel patterns and anomalies. Concurrently, the application of normalized flows within the autoencoder framework serves to constrain the latent space, effectively isolating anomalies and improving detection accuracy. Experimental validation conducted on two large-scale public datasets demonstrates the efficacy of the proposed method compared to established benchmarks, highlighting its superior performance.
暂无评论