The Electrocardiogram (ECG) test detects and records cardiac-related electrical activity of the heart. The ECG test identifies and documents cardiac-related electrical activity in the heart. The use of ECG signals for...
详细信息
The Electrocardiogram (ECG) test detects and records cardiac-related electrical activity of the heart. The ECG test identifies and documents cardiac-related electrical activity in the heart. The use of ECG signals for cardiovascular disease nursing as a crucial component of preoperative evaluation is increasing. ECG signals need to denoise and display in a clear waveform due to the numerous noises. We have introduced Compact Shortcut denoising Auto-encoder (CS-DAE) neural network, which reduces the noise from ECG signals. The Compact Shortcut approach compresses the features passed through the shortcut layers, which lowers the operation's memory needs and improves the noise reduction impact. In addition, the encoder and decoder process the Pixel-Unshuffled and Pixel-Shuffled, which effectively mitigates the feature loss caused by down-sampling and up-sampling operations. As a result, the CS-DAE algorithm decreases the computation and required memory size while maintaining higher accuracy. We have used MITDB and NSTDB datasets for training and testing the proposed CS-DAE model, resulting in the average Percentage of Root Mean Square Difference (PRD) being 46.30% and the improvement of Signal-to-Noise Ratio (SNRimp) being 10.50. In addition, we have designed VLSI architect ure for the proposed CS-DAE neural network to accelerate low hardware cost and less computation. The TUL PYNQTM-Z2 development platform runs the Verilog code, which is used for VLSI architecture and has the lowest power consumption of 1.65W.
Guided ultrasonic wave (GUW) monitoring systems for pipeline structures are gaining much attention in critical sectors such as the petrochemical, nuclear and energy sectors. However, the effects of environmental and o...
详细信息
Guided ultrasonic wave (GUW) monitoring systems for pipeline structures are gaining much attention in critical sectors such as the petrochemical, nuclear and energy sectors. However, the effects of environmental and operational conditions (EOCs), especially temperature, may generate substantial false damage detections. The temperature effect may interfere with different coherent noise sources and generate unwanted peaks that are falsely identified as damage. In this paper, a denoising autoencoder (DAE) is proposed to reduce the frequency of false damage detections in GUW monitoring systems. A DAE decodes high dimensional data into low-dimensional features and reconstructs the original data from these low-dimensional features. By providing signals at a reference temperature with the fewest false damage detections, this structure forces the DAE to learn the essential features hidden within complex data. A database of GUW signals is formed based on the experimental measurements using a six-metre-long stainless steel Schedule 20 pipe. Variations in temperature and damage severity are applied to develop the database to mimic a simple step change in damage growth under EOCs. The outcomes obtained from this study show that the proposed methodology can reduce false damage detections during GUW monitoring and is valuable for pipeline safety evaluations.
Pipeline failures are often caused by the expansion of small defects. Structural damage to pipelines can lead to major safety accidents. When ultrasonic guided wave (UGW) technology is used for pipeline failure detect...
详细信息
Pipeline failures are often caused by the expansion of small defects. Structural damage to pipelines can lead to major safety accidents. When ultrasonic guided wave (UGW) technology is used for pipeline failure detection, the echoes produced by small defects manifest as weak UGW signals amidst significant noise. The low amplitude of these signals or complete drowning by noise makes them difficult to recognize. This study innovatively introduces a one-dimensional convolutional neural network denoising autoencoder (1DCNN-based DAE) for noise reduction in UGW signals using deep learning. To improve the conventional DAE, the model incorporated the Parametric Rectified Linear Unit (PReLU) activation function and a CNN for enhanced feature extraction, resulting in the proposed 1DCNN-based DAE. The model is trained on an extensive dataset of mixed signals with strong noise and their corresponding clean signals, enabling autonomous denoising in an unsupervised manner. Additionally, this paper proposes the application of the window-shifted power spectrum method for analyzing the denoised signals to identify and locate pipeline defects. The method involves traversing the signal with a window to intercept fragments, calculating their power, and plotting the power spectrum curve. Defects are then located based on the peak positions of this curve. Numerical simulation and experimental signals were used to validate the proposed method. Simulation results showed that the proposed 1DCNN-based DAE effectively improved the signal-to-noise ratio (SNR) of UGW mixed signals from -9 dB to 21.63 dB, representing an improvement of up to 30.63 dB. Experimental results demonstrated that the method accurately detected weak UGW signals from small defective pipes with a 2 % cross-section loss rate, achieving over 90 % recognition confidence and less than 1.5 % axial positioning error rate. In summary, the proposed 1DCNN-based DAE can effectively improve the SNR of the signal, reduce the noise i
Isonicotinic acid (INA) has attracted considerable interest as a crucial pharmaceutical intermediate, especially for the production of the anti-tuberculosis drug isoniazid. Nonetheless, industrial production of INA en...
详细信息
Isonicotinic acid (INA) has attracted considerable interest as a crucial pharmaceutical intermediate, especially for the production of the anti-tuberculosis drug isoniazid. Nonetheless, industrial production of INA encompasses intricate procedures that are highly sensitive to process parameters, leading to yield variability. Hence, an efficient prediction model for forecasting INA yield is essential for enhancing production yields and ensuring the consistency of INA in pharmaceutical manufacturing processes. To address this challenge, the present study developed a brain-inspired spiking neural network (SNN) tailored to the prediction of INA yield. Specifically, we propose a novel denoising autoencoder multilayer perceptron based spiking neural network (DAEMLP-SNN) for this purpose. The SNN is designed to accurately emulate the dynamic behavior of biological neurons while maintaining low power consumption, thereby ensuring high biological plausibility. Drawing upon the principles of autoencoders, our research constructs a denoising autoencoder SNN capable of extracting meaningful latent features and compressing high-dimensional industrial data. Moreover, we concatenated the extracted features with the original data, thereby creating a more comprehensive representation of the input. This enriched input was then fed into the multilayer perceptron SNN, which markedly enhances the robustness and precision of INA yield predictions. Experimental findings demonstrated the superior performance of DAEMLP-SNN, as it consistently achieved accurate predictions across diverse process parameters.
In this report, we address the question of combining nonlinearities of neurons into networks for modeling increasingly varying and progressively more complex functions. A fundamental approach is the use of higher-leve...
详细信息
In this report, we address the question of combining nonlinearities of neurons into networks for modeling increasingly varying and progressively more complex functions. A fundamental approach is the use of higher-level representations devised by restricted Boltzmann machines and (denoising) autoencoders. We present the denoising autoencoder Self-Organizing Map (DASOM) that integrates the latter into a hierarchically organized hybrid model where the front-end component is a grid of topologically ordered neurons. The approach is to interpose a layer of hidden representations between the input space and the neural lattice of the self-organizing map. In so doing the parameters are adjusted by the proposed unsupervised learning algorithm. The model therefore maintains the clustering properties of its predecessor, whereas by extending and enhancing its visualization capacity enables an inclusion and an analysis of the intermediate representation space. A comprehensive series of experiments comprising optical recognition of text and images, and cancer type clustering and categorization is used to demonstrate DASOM's efficiency, performance and projection capabilities. (C) 2018 Elsevier Ltd. All rights reserved.
Electric load data are essential for data-driven approaches (including deep learning) in smart grid, and advanced smart meter technologies provide fine-grained data with reliable communications. Despite the recent dev...
详细信息
Electric load data are essential for data-driven approaches (including deep learning) in smart grid, and advanced smart meter technologies provide fine-grained data with reliable communications. Despite the recent development of smart metering devices, however, missing data still arise due to unexpected device power off, communication failure, measuring error, or other unknown reasons. In this paper, we investigate a deep learning framework for missing imputation of smart meter data by leveraging a denoising autoencoder (DAE). Then, we compare the performance of the proposed DAE with traditional methods as well as other recently developed generative models, e.g., variational autoencoder and Wasserstein autoencoder. The proposed DAE based imputation shows significantly better results compared to other methods in terms of root mean square error (RMSE) by up to 28.9% for point-wise error, and by up to 56% for daily-accumulated error.
Precise biomarker development is a key step in disease management. However, most of the published biomarkers were derived from a relatively small number of samples with supervised approaches. Recent advances in unsupe...
详细信息
Precise biomarker development is a key step in disease management. However, most of the published biomarkers were derived from a relatively small number of samples with supervised approaches. Recent advances in unsupervised machine learning promise to leverage very large datasets for making better predictions of disease biomarkers. denoising autoencoder(DA) is one of the unsupervised deep learning algorithms, which is a stochastic version of autoencoder techniques. The principle of DA is to force the hidden layer of autoencoder to capture more robust features by reconstructing a clean input from a corrupted one. Here, a DA model was applied to analyze integrated transcriptomic data from 13 published lung cancer studies, which consisted of 1916 human lung tissue samples. Using DA, we discovered a molecular signature composed of multiple genes for lung adenocarcinoma(ADC). In independent validation cohorts, the proposed molecular signature is proved to be an effective classifier for lung cancer histological subtypes. Also, this signature successfully predicts clinical outcome in lung ADC, which is independent of traditional prognostic factors. More importantly, this signature exhibits a superior prognostic power compared with the other published prognostic genes. Our study suggests that unsupervised learning is helpful for biomarker development in the era of precision medicine.
Recently, the colloidal quantum dot spectrometer has received much attention due to its advantages in cost, size, and operation. Yet, just like many other filter-based miniature spectrometers, spectrum reconstruction ...
详细信息
Recently, the colloidal quantum dot spectrometer has received much attention due to its advantages in cost, size, and operation. Yet, just like many other filter-based miniature spectrometers, spectrum reconstruction for the colloidal quantum dot spectrometer is typically prone to the measurement noise due to the correlation of the filters. In this paper, we propose an effective spectrum reconstruction method for the colloidal quantum dot spectrometer, which can recover high-quality spectra in noisy environments. Specifically, we employ a denoising autoencoder, a machine-learning approach, to reduce noise in the filters' raw measurements before performing the reconstruction. After that, we reconstruct the spectra with the denoised data by a sparse recovery algorithm. We investigate the feasibility of the proposed reconstruction approach on a synthetic dataset and an experimental dataset collected by the colloidal quantum dot spectrometer. The results demonstrate that the proposed approach could deliver accurate reconstruction results even when data are corrupted with the measurement noise.
In contrast to conventional localization methods, connectivity-based localization is a promising approach that leverages wireless links among network nodes. Here, the Euclidean distance matrix (EDM) plays a pivotal ro...
详细信息
In contrast to conventional localization methods, connectivity-based localization is a promising approach that leverages wireless links among network nodes. Here, the Euclidean distance matrix (EDM) plays a pivotal role in implementing the multidimensional scaling technique for the localization of wireless nodes based on pairwise distance measurements. This is based on the representation of complex datasets in lower-dimensional spaces, resulting from the mathematical property of an EDM being a low-rank matrix. However, EDM data are inevitably susceptible to contamination due to errors such as measurement imperfections, channel dynamics, and clock asynchronization. Motivated by the low-rank property of the EDM, we introduce a new pre-processor for connectivity-based localization, namely denoising-autoencoder-aided EDM reconstruction (DAE-EDMR). The proposed method is based on optimizing the neural network by inputting and outputting vectors of the eigenvalues of the noisy EDM and the original EDM, respectively. The optimized NN denoises the contaminated EDM, leading to an exceptional performance in connectivity-based localization. Additionally, we introduce a relaxed version of DAE-EDMR, i.e., truncated DAE-EDMR (T-DAE-EDMR), which remains operational regardless of variations in the number of nodes between the training and test phases in NN operations. The proposed algorithms show a superior performance in both EDM denoising and localization accuracy. Moreover, the method of T-DAE-EDMR notably requires a minimal number of training datasets compared to that in conventional approaches such as deep learning algorithms. Overall, our proposed algorithms reduce the required training dataset's size by approximately one-tenth while achieving more than twice the effectiveness in EDM denoising, as demonstrated through our experiments.
Text style transfer task is transferring sentences to other styles while preserving the semantics as much as possible. In this work, we study a two-step text style transfer method on non-parallel datasets. In the firs...
详细信息
ISBN:
(纸本)9783030863654;9783030863647
Text style transfer task is transferring sentences to other styles while preserving the semantics as much as possible. In this work, we study a two-step text style transfer method on non-parallel datasets. In the first step, the style-relevant words are detected and deleted from the sentences in the source style corpus. In the second step, the remaining style-devoid contents are fed into a Natural Language Generation model to produce sentences in the target style. The model consists of a style encoder and a pre-trained denoisingautoencoder. The former extracts style features of each style corpus and the latter reconstructs source sentences during training and generates sentences in the target style during inference from given contents. We conduct experiments on two text sentiment transfer datasets and comprehensive comparisons with other relevant methods in terms of several evaluation aspects. Evaluation results show that our method outperforms others in terms of sentence fluency and achieves a decent tradeoff between content preservation and style transfer intensity. The superior performance on the Caption dataset illustrates our method's potential advantage on occasions of limited data.
暂无评论