The attacks on in-vehicle Controller Area Network(CAN)bus messages severely disrupt normal communication between ***,researches on intrusion detection models for CAN have positive business value for vehicle security,a...
详细信息
The attacks on in-vehicle Controller Area Network(CAN)bus messages severely disrupt normal communication between ***,researches on intrusion detection models for CAN have positive business value for vehicle security,and the intrusion detection technology for CAN bus messages can effectively protect the invehicle network from unlawful *** machine learning-based models are unable to effectively identify intrusive abnormal messages due to their inherent ***,to address the shortcomings of the previous machine learning-based intrusion detection technique,we propose a novel method using Attention Mechanism and autoencoder for Intrusion Detection(AMAEID).The AMAEID model first converts the raw hexadecimal message data into binary format to obtain better *** the AMAEID model encodes and decodes the binary message data using a multi-layer denoising autoencoder model to obtain a hidden feature representation that can represent the potential features behind the message data at a deeper ***,the AMAEID model uses the attention mechanism and the fully connected layer network to infer whether the message is an abnormal message or *** experimental results with three evaluation metrics on a real in-vehicle CAN bus message dataset outperform some traditional machine learning algorithms,demonstrating the effectiveness of the AMAEID model.
Deep-learning (DL) methods have shown promising performance in pioneering studies on orthogonal frequency division multiplexing (OFDM) channel estimation challenges. Unlike typical DL-based channel estimation methods ...
详细信息
Deep-learning (DL) methods have shown promising performance in pioneering studies on orthogonal frequency division multiplexing (OFDM) channel estimation challenges. Unlike typical DL-based channel estimation methods that mainly rely on separate real and imaginary inputs while ignoring the inherent correlation between the two streams, this paper proposes AE-DENet, a novel autoencoder (AE)-based data enhancement network to achieve robust channel estimation for OFDM systems. AE-DENet employs the classic least square (LS) channel estimation as input and proposes a data enhancement method to extract the interaction features from the real and imaginary parts of the complex channel estimation matrix, which are joined with the original real and imaginary streams to generate an enhanced input for better channel inference. Experimental findings in terms of the mean square error (MSE) results for a range of representative DL-based channel estimation methods demonstrate that the proposed AE-DENet-enhanced channel estimation framework achieves state-of-the-art channel estimation performance with trivial added computational complexity. Furthermore, the input dimensions of the DL-based channel estimation models can be adaptively adjusted to accommodate the dimension of the enhanced LS input. The proposed approach is also shown to be robust to channel variations and high user mobility.
This study develops an automatic defect detection system for polyvinyl chloride (PVC) profile manufacturing, addressing inefficiencies in manual inspection. It compares the proposed autoencoder model with other well-k...
详细信息
This study develops an automatic defect detection system for polyvinyl chloride (PVC) profile manufacturing, addressing inefficiencies in manual inspection. It compares the proposed autoencoder model with other well-known unsupervised deep-learning methods, including GANomaly, f-AnoGAN, and the student-teacher network, for defect detection during extrusion. Utilising a defective PVC profile dataset, the study generates anomaly heat maps through reconstruction errors and assesses model performance using the area under the receiver operating characteristic (ROC) curve. The proposed autoencoder model is found to be optimal for this dataset, offering a balance between efficiency and accuracy. These findings have significant implications for enhancing quality control and reducing defects in PVC manufacturing, with potential applicability in other industrial settings.
Although speech emotion recognition is challenging,it has broad application prospects in human-computer *** a system that can accurately and stably recognize emotions from human languages can provide a better user ***...
详细信息
Although speech emotion recognition is challenging,it has broad application prospects in human-computer *** a system that can accurately and stably recognize emotions from human languages can provide a better user ***,the current unimodal emotion feature representations are not distinctive enough to accomplish the recognition,and they do not effectively simulate the inter-modality dynamics in speech emotion recognition *** paper proposes a multimodal method that utilizes both audio and semantic content for speech emotion *** proposed method consists of three parts:two high-level feature extractors for text and audio modalities,and an autoencoder-based feature *** audio modality,we propose a structure called Temporal Global Feature Extractor(TGFE)to extract the high-level features of the timefrequency domain relationship from the original speech *** that text lacks frequency information,we use only a Bidirectional Long Short-Term Memory network(BLSTM)and attention mechanism to simulate an intra-modal *** these steps have been accomplished,the high-level text and audio features are sent to the autoencoder in parallel to learn their shared representation for final emotion *** conducted extensive experiments on three public benchmark datasets to evaluate our *** results on Interactive Emotional Motion Capture(IEMOCAP)and Multimodal EmotionLines Dataset(MELD)outperform the existing ***,the results of CMU Multi-modal Opinion-level Sentiment Intensity(CMU-MOSI)are ***,experimental results show that compared to unimodal information and autoencoderbased feature level fusion,the joint multimodal information(audio and text)improves the overall performance and can achieve greater accuracy than simple feature concatenation.
This study presents an autoencoder-embedded optimization(AEO)algorithm which involves a bi-population cooperative strategy for medium-scale expensive problems(MEPs).A huge search space can be compressed to an informat...
详细信息
This study presents an autoencoder-embedded optimization(AEO)algorithm which involves a bi-population cooperative strategy for medium-scale expensive problems(MEPs).A huge search space can be compressed to an informative lowdimensional space by using an autoencoder as a dimension reduction *** search operation conducted in this low space facilitates the population with fast convergence towards the *** strike the balance between exploration and exploitation during optimization,two phases of a tailored teaching-learning-based optimization(TTLBO)are adopted to coevolve solutions in a distributed fashion,wherein one is assisted by an autoencoder and the other undergoes a regular evolutionary ***,a dynamic size adjustment scheme according to problem dimension and evolutionary progress is proposed to promote information exchange between these two phases and accelerate evolutionary convergence *** proposed algorithm is validated by testing benchmark functions with dimensions varying from 50 to *** indicated in our experiments,TTLBO is suitable for dealing with medium-scale problems and thus incorporated into the AEO framework as a base *** with the state-of-the-art algorithms for MEPs,AEO shows extraordinarily high efficiency for these challenging problems,t hus opening new directions for various evolutionary algorithms under AEO to tackle MEPs and greatly advancing the field of medium-scale computationally expensive optimization.
Android security incidents occurred frequently in recent years. To improve the accuracy and efficiency of large-scale Android malware detection, in this work, we propose a hybrid model based on deep autoencoder (DAE) ...
详细信息
Android security incidents occurred frequently in recent years. To improve the accuracy and efficiency of large-scale Android malware detection, in this work, we propose a hybrid model based on deep autoencoder (DAE) and convolutional neural network (CNN). First, to improve the accuracy of malware detection, we reconstruct the high-dimensional features of Android applications (apps) and employ multiple CNN to detect Android malware. In the serial convolutional neural network architecture (CNN-S), we use Relu, a non-linear function, as the activation function to increase sparseness and dropout to prevent over-fitting. The convolutional layer and pooling layer are combined with the full-connection layer to enhance feature extraction capability. Under these conditions, CNN-S shows powerful ability in feature extraction and malware detection. Second, to reduce the training time, we use deep autoencoder as a pre-training method of CNN. With the combination, deep autoencoder and CNN model (DAE-CNN) can learn more flexible patterns in a short time. We conduct experiments on 10,000 benign apps and 13,000 malicious apps. CNN-S demonstrates a significant improvement compared with traditional machine learning methods in Android malware detection. In details, compared with SVM, the accuracy with the CNN-S model is improved by 5%, while the training time using DAE-CNN model is reduced by 83% compared with CNN-S model.
K-nearest neighbor(KNN)is one of the most fundamental methods for unsupervised outlier detection because of its various advantages,e.g.,ease of use and relatively high ***,most data analytic tasks need to deal with hi...
详细信息
K-nearest neighbor(KNN)is one of the most fundamental methods for unsupervised outlier detection because of its various advantages,e.g.,ease of use and relatively high ***,most data analytic tasks need to deal with high-dimensional data,and the KNN-based methods often fail due to“the curse of dimensionality”.autoencoder-based methods have recently been introduced to use reconstruction errors for outlier detection on high-dimensional data,but the direct use of autoencoder typically does not preserve the data proximity relationships well for outlier *** this study,we propose to combine KNN with autoencoder for outlier ***,we propose the Nearest Neighbor autoencoder(NNAE)by persevering the original data proximity in a much lower dimension that is more suitable for performing ***,we propose the K-nearest reconstruction neighbors(K NRNs)by incorporating the reconstruction errors of NNAE with the K-distances of KNN to detect ***,we develop a method to automatically choose better parameters for optimizing the structure of ***,using five real-world datasets,we experimentally show that our proposed approach NNAE+K NRN is much better than existing methods,i.e.,KNN,Isolation Forest,a traditional autoencoder using reconstruction errors(autoencoder-RE),and Robust autoencoder.
Nowadays,the personalized recommendation has become a research hotspot for addressing information *** this,generating effective recommendations from sparse data remains a ***,auxiliary information has been widely used...
详细信息
Nowadays,the personalized recommendation has become a research hotspot for addressing information *** this,generating effective recommendations from sparse data remains a ***,auxiliary information has been widely used to address data sparsity,but most models using auxiliary information are linear and have limited *** to the advantages of feature extraction and no-label requirements,autoencoder-based methods have become quite ***,most existing autoencoder-based methods discard the reconstruction of auxiliary information,which poses huge challenges for better representation learning and model *** address these problems,we propose Serial-autoencoder for Personalized Recommendation(SAPR),which aims to reduce the loss of critical information and enhance the learning of feature ***,we first combine the original rating matrix and item attribute features and feed them into the first autoencoder for generating a higher-level representation of the ***,we use a second autoencoder to enhance the reconstruction of the data representation of the prediciton rating *** output rating information is used for recommendation *** experiments on the MovieTweetings and MovieLens datasets have verified the effectiveness of SAPR compared to state-of-the-art models.
This paper presents an IC implementation of on-chip learning neuromorphic autoencoder unit in a form of rate-based spiking neural network. With a current-mode signaling scheme embedded in a 500 x 500 6b SRAM-based mem...
详细信息
This paper presents an IC implementation of on-chip learning neuromorphic autoencoder unit in a form of rate-based spiking neural network. With a current-mode signaling scheme embedded in a 500 x 500 6b SRAM-based memory, the proposed architecture achieves simultaneous processing of multiplications and accumulations. In addition, a transposable memory read for both forward and backward propagations and a virtual lookup table are also proposed to perform an unsupervised learning of restricted Boltzmann machine. The IC is fabricated using 28-nm CMOS process and is verified in a three-layer network of encoder-decoder pair for training and recovery of images with two-dimensional 16 x 16 pixels. With a dataset of 50 digits, the IC shows a normalized root mean square error of 0.078. Measured energy efficiencies are 4.46 pJ per synaptic operation for inference and 19.26 pJ per synaptic weight update for learning, respectively. The learning performance is also estimated by simulations if the proposed hardware architecture is extended to apply to a batch training of 60 000 MNIST datasets.
Dynamic community detection is significant for controlling and capturing the temporal features of networks. The evolutionary clustering framework provides a temporal smoothness constraint for simultaneously maximizing...
详细信息
Dynamic community detection is significant for controlling and capturing the temporal features of networks. The evolutionary clustering framework provides a temporal smoothness constraint for simultaneously maximizing the clustering quality at the current time step and minimizing the clustering deviation between two successive time steps. Based on this framework, some existing methods, such as the evolutionary spectral clustering and evolutionary nonnegative matrix factorization, aim to look for the low-dimensional representation by mapping reconstruction. However, such reconstruction does not address the nonlinear characteristics of networks. In this paper, we propose a semi-supervised algorithm(sE-autoencoder) to overcome the effects of nonlinear property on the low-dimensional representation. Our proposed method extends the typical nonlinear reconstruction model to the dynamic network by constructing a temporal matrix. More specifically, the potential community characteristics and the previous clustering, as the prior information,are incorporated into the loss function as a regularization term. Experimental results on synthetic and realworld datasets demonstrate that the proposed method is effective and superior to other methods for dynamic community detection.
暂无评论