This work aims to propose a novel architecture and training strategy for graph convolutional networks (GCN). The proposed architecture, named autoencoder-Aided GCN (AA-GCN), compresses the convolutional features in an...
详细信息
ISBN:
(纸本)9781665405409
This work aims to propose a novel architecture and training strategy for graph convolutional networks (GCN). The proposed architecture, named autoencoder-Aided GCN (AA-GCN), compresses the convolutional features in an information-rich embedding at multiple hidden layers, exploiting the presence of autoencoders before the point-wise nonlinearities. Then, we propose a novel end-to-end training procedure that learns different graph representations per layer, jointly with the GCN weights and auto-encoder parameters. As a result, the proposed strategy improves the computational scalability of the GCN, learning the best graph representations at each layer in a data-driven fashion. Several numerical results on synthetic and real data illustrate how our architecture and training procedure compares favorably with other state-of-the-art solutions, both in terms of robustness and learning performance.
Customer segmentation is a core issue in the customer relationship management community. It provides an important reference for companies to understand customers' needs and develop accurate marketing programs by d...
详细信息
ISBN:
(数字)9781728186719
ISBN:
(纸本)9781728186719
Customer segmentation is a core issue in the customer relationship management community. It provides an important reference for companies to understand customers' needs and develop accurate marketing programs by dividing customers with similar needs into specific categories. With the advent of the era of big data, the recorded data of customer characteristics become more diversified, and the data dimension presents a trend of sharp growth. The relationships among data have become more complicated, and both manual statistical analysis and traditional clustering algorithms have encountered bottlenecks. A kind of work that uses autoencoder to reduce dimensions and then conducts clustering research provides a good solution to this problem. autoencoder can effectively capture nonlinear and complex data features by stacking hidden layers with activation functions. However, the uncontrollability of the encoding-decoding process in autoencoders is neglected in the existing research on autoencoders. To solve this problem, a gated enhanced autoencoder(GEAE) is proposed in this paper. The gating block connection between encoder and decoder is established to make the encoding process guide the decoding process and reduce the uncontrollability of the encoding-decoding process. We verify the validity of the proposed method on a real data set for customer segmentation. GEAE obviously outperforms AE in terms of both reconstruction performance and the effect of downstream clustering tasks. In addition, this research also verifies the importance of selecting the appropriate position of the gating block in GEAE through ablation experiments.
Collaborative intelligence (CI) has been proposed to efficiently utilize computational resources on edge devices over edge-cloud environments. To realize this, a deep neural network (DNN) model is divided into two par...
详细信息
ISBN:
(数字)9781665496209
ISBN:
(纸本)9781665496209
Collaborative intelligence (CI) has been proposed to efficiently utilize computational resources on edge devices over edge-cloud environments. To realize this, a deep neural network (DNN) model is divided into two parts, which are deployed to the edge device and cloud separately so that they can perform DNN inference collaboratively. Feature compression methods have been investigated to reduce the traffic volume between the edge and cloud because the data size of a feature map, which is the output of the edge device in CI, is relatively larger than that of the compressed original image. Although feature compression methods can achieve a good compression rate, the traffic volume is not small enough because the data size of a feature map might exceed that of the original image. Herein, we propose a novel feature compression method that utilizes an autoencoder (AE) to compress the feature map. In image compression, distortion and data size are minimized, whereas in our method, the AE is trained to minimize the prediction error and data size. In this way, the AE can extract only the data needed for the task of the DNN model and considerably reduce the data size while maintaining the prediction accuracy. In performance evaluation, we apply the proposed method to widely used convolutional neural network models: VGG16, ResNet50, and YOLOv3. Our results confirm that the proposed method drastically reduces the traffic volume while utilizing the resources of edge devices in CI. Our proposed method reduces the traffic volume by 62-99%, 16-99%, and 35-53% compared to versatile video coding in each model.
In our brain, the visual information captured by the retina is processed by the two different visual pathways known as ventral stream and the dorsal stream. The ventral stream known as the "what pathway" is ...
详细信息
ISBN:
(纸本)9783031063817;9783031063800
In our brain, the visual information captured by the retina is processed by the two different visual pathways known as ventral stream and the dorsal stream. The ventral stream known as the "what pathway" is involved with object and visual identification and recognition and the dorsal stream known as "where pathway" is involved with processing the object's spatial location relative to the viewer. This means that the human brain decomposes the visual information captured by the retina into the invariant information and the variant information. In this paper, we propose two network architectures based on the convolutional autoencoder in order to decompose the input information into invariant information and variant information. The decomposition of variant and invariant information is realized by decomposing the feature vectors obtained in the hidden layer of the convolutional autoencoder. To extract invariant information, the classifier or the estimator of the invariant image are combined with the convolutional autoencoder. Effectiveness of the proposed architectures are experimentally confirmed by visualizing the extracted feature vectors.
Student dropout represents a social, resource and time loss for everyone involved. By identifying students with the potential to evade, it is possible to take the necessary measures to prevent that from happening. Thi...
详细信息
ISBN:
(数字)9781665488587
ISBN:
(纸本)9781665488587
Student dropout represents a social, resource and time loss for everyone involved. By identifying students with the potential to evade, it is possible to take the necessary measures to prevent that from happening. This paper investigates different techniques for classification using a real students dataset that is multivariate, sequential and imbalanced. To address imbalance, an approach using weighted loss function and an approach using synthetic data generated through a combination of variational autoencoder and the Adaptive Synthetic (ADASYN) technique were investigated. In addition, we propose two models for predicting evasion using LSTM and 1D CNN networks to take advantage of the multivariate sequential property. The experiments showed that the approach only with LSTM architecture in the dynamic module using the preprocessed original dataset and without the use of weighted loss function obtained the best mean sensitivity (0.9676) among the investigated proposals. The LSTM architecture in the dynamic module using the preprocessed original dataset with weighted loss function had better specificity (0.9558) and area under curve (0.9735). Both had the same mean accuracy of 0.9549.
In order to improve predictive accuracy for insufficient observations, data augmentation is a well-known and commonly useful technique to increase more samples by generating new data which can avoid data collection pr...
详细信息
ISBN:
(纸本)9781665400145
In order to improve predictive accuracy for insufficient observations, data augmentation is a well-known and commonly useful technique to increase more samples by generating new data which can avoid data collection problems. This paper presents comparison analysis of three data augmentation methods using Bootstrap method, Generative Adversarial Networks (GANs) and autoencoder for increasing a number of samples. The proposal is applied on 8 datasets with binary classification from repository data websites. The research is mainly evaluated by generating new additional data using data augmentation. Secondly, combining generated samples and original data. Finally, validating performance on four classifier models. The experimental result showed that the proposed approach of increasing samples by autoencoder and GANs achieved better predictive performance than the original data. Conversely, increasing samples by Bootstrap method provided lowest predictive performance.
This work proposes a system that optimises multidimensional signal transmission, utilising signals with probabilistic shaping designed with the aid of end-to-end learning of an autoencoder-based architecture. For the ...
详细信息
ISBN:
(纸本)9781665442664
This work proposes a system that optimises multidimensional signal transmission, utilising signals with probabilistic shaping designed with the aid of end-to-end learning of an autoencoder-based architecture. For the first time, this work reports bit mapping optimisation for multidimensional signals and applied the newly derived optimised signals to the probabilistic shaping system. The autoencoder employs two neural networks for the transceiver, separated by the embedded channel. The optimisation of the autoencoder configuration is implemented for probabilistic shaping for n-dimensional signals. Specifically, We investigate a 4-dimensional (4D) signal employing 2 successive time slots that has better noise immunity relative to regular 2-dimensional quadrature amplitude modulation (QAM) signals. We propose a new application of autoencoders in communication systems based on 4D signals and apply machine learning to optimise the 4D probabilistic shaping on the basis of receiver signal-to-noise-ratio (SNR). The performance of the optimised probabilistically shaped 4D signals is evaluated in terms of the bit error rate (BER) and mutual information. Simulation results show that the proposed probabilistically shaped 4D signal achieves better BER performance relative to the unshaped 4D and regular 2D QAM. We demonstrate the mutual information of the proposed signal with varying SNR, showing its improved capacity in comparison with other constellations.
Hyperspectral classification is a fundamental problem for applying hyperspectral technology, and unsupervised learning is a promising direction to address the issue. Unsupervised feature learning algorithm extracts re...
详细信息
Hyperspectral classification is a fundamental problem for applying hyperspectral technology, and unsupervised learning is a promising direction to address the issue. Unsupervised feature learning algorithm extracts representative features, which help efficiently classify the hyperspectral pixels. This paper combines the popular contrastive learning method (prototypical contrastive learning) and the classic representation learning method (autoencoder) to design an unsupervised feature learning network for hyperspectral classification. First, two different encoders are used to extract different features as augmentation function in a contrastive network (ContrastNet). Second, the prototypical contrastive learning method is adopted to train a contrastive network. Third, features extracted by the contrastive network are used for classification. Experiments have proved that our two proposed autoencoder networks show good feature learning capabilities by themselves and the designed contrastive learning network can further learn better representative features from the two modules. The three modules compose an efficient framework for unsupervised feature learning. Our method also performs reasonably fast in the testing phase, which implies that it is applicable in practice under specific conditions. (C) 2021 Elsevier B.V. All rights reserved.
Under variable working conditions, a problem arises, which is that it is difficult to obtain enough labeled data;to address this problem, an adaptive transfer autoencoder (ATAE) is established to diagnose faults in ro...
详细信息
Under variable working conditions, a problem arises, which is that it is difficult to obtain enough labeled data;to address this problem, an adaptive transfer autoencoder (ATAE) is established to diagnose faults in rotating machinery. First, a data adaptation module, which calculates the maximum mean discrepancy for the network hidden-layer data in reproducing kernel Hilbert space, is introduced to the autoencoder network, thus making the classification model operate under variable working conditions. Variation particle-swarm optimization is then invoked to optimize the data adaptation parameters. Finally, the k-nearest neighbors algorithm, as the classification layer of the network, identifies the state of health of the rotating machinery. The capabilities of the intelligent fault-diagnosis network are verified using vibration signals from a bearing test rig and a gearbox test rig. The experimental results suggest that, compared with state-of-the-art diagnosis methods, the proposed ATAE network can significantly boost diagnostic performance in the absence of target vibration signal labels.
The signal-noise ratio plays a key role in acquiring plentiful chemical structural information in the Raman spectrometer. The miniature spectrometer is generally compact at the expense of performance. In this work, we...
详细信息
The signal-noise ratio plays a key role in acquiring plentiful chemical structural information in the Raman spectrometer. The miniature spectrometer is generally compact at the expense of performance. In this work, we proposed a compact, signal-to-noise ratio (SNR) enhancement of the Raman spectrometer by the optimization of optical structure and a noise reduction method. Concerning its optical structure, the Raman spectrometer is increasing the intensity by adding an off-the-shelf cylindrical lens. On the other side of the algorithm, a relevant automatic denoising method of convolutional denoising autoencoder (CDAE) is proposed to further advance the SNR in Raman spectra without manual intervention. The results indicate the performance of the compact Raman spectrometer could increase to a certain extent by testing with 785 nm laser and Ne/Ar source. Besides, by using CDAE to deal with contaminated Raman spectra, a higher SNR is obtained. The results demonstrate that the improvement of the hardware and algorithm is effective for removing the noisy Raman signal and achieving higher SNR. This result may be helpful in further improving the performance of integrated Raman spectrometers and research on miniaturized instruments.
暂无评论