Locally Linear Embedding (LLE) is a sort of powerful nonlinear dimensionality reduction algorithms. The basic idea behind the LLE method is that each data point and its neighbors lie on or close to a locally linear pa...
详细信息
ISBN:
(纸本)9781479914821
Locally Linear Embedding (LLE) is a sort of powerful nonlinear dimensionality reduction algorithms. The basic idea behind the LLE method is that each data point and its neighbors lie on or close to a locally linear patch of the manifold if there is sufficient data. Then the local geometry of these patches is described by using linear coefficients which can reconstruct each data point from its neighbors. However, LLE operates in a batch way and its dimension reduction cannot be generalized to unseen samples. If a test sample arrives, LLE must run repeatedly and the former computational results are discarded. Thus, some incremental methods have been proposed for LLE to solve this problem. In these incremental methods, the neighbor number is globally fixed, which may result in selecting points from another linear space as neighbors. This paper presents LLE based on orthogonal matching pursuit (OMP) and applies it to classification tasks. In the classification tasks, dimensionality reduction on test samples is implemented by applying dimension reduction on training samples. The new LLE method could select a more appropriate neighbors from the selected neighbors. OMP is applied to not only LLE for training samples, but also the incremental learning of LLE for test samples. Compared with other linear incremental methods, experimental results show that the proposed method is promising.
Deep networks are well known for their powerful function approximations. To train a deep network efficiently, greedy layer-wise pre-training and fine tuning are required. Typically, pre-training, aiming to initialize ...
详细信息
ISBN:
(纸本)9781479914821
Deep networks are well known for their powerful function approximations. To train a deep network efficiently, greedy layer-wise pre-training and fine tuning are required. Typically, pre-training, aiming to initialize a deep network, is implemented via unsupervised feature learning, with multiple feature representations generated. However, in general only the last layer representation is to be employed because of its abstraction and compactness being the best with comparisons to the ones of lower layers. To make full use of the representations of all layers, this paper proposes a feature ensemble learning method based on sparse autoencoders for image classification. Specifically, we train three softmax classifiers by using the representations of different layers, instead of one classifier trained by applying the last layer representation. Of the three softmax classifiers, two are obtained by training stacked auto-encoders with fine tuning, and the other one is obtained by directly using a concatenation of two representations. To improve accuracy and stability of a single softmax classifier, the ensemble of multiple classifiers is considered, and some Naive Bayes combination rules are introduced to integrate the three classifiers. Experimental results on the MNIST and COIL datasets are presented, with comparisons to other classification methods.
Fountain code is a class of graph-based linear erasure codes, which can effectively solve the problems such as network congestion and feedback cracking for its characteristics of rateless and can resume when interrupt...
详细信息
ISBN:
(纸本)9781479973408
Fountain code is a class of graph-based linear erasure codes, which can effectively solve the problems such as network congestion and feedback cracking for its characteristics of rateless and can resume when interrupted, and has a lower complexity of encoding and decoding. However, there are still some problems in the process of encoding and decoding, including the degree distribution structure may be destroyed, parameters of the generating matrix are not fixed, and it cannot recover source datas from the remaining encoded packets with no degree one. So, the basic theory of fountain codes from three aspects are introduced in this paper, i.e., degree distribution, encoding and decoding principles. Therefore the improved algorithms according to the above three aspects are presented. Simulation results show that the proposed algorithm is more efficient than the previous one.
Similarity learning is one of the most fundamental notions in machine learning and pattern recognition. In real-world problems, the number of the paired-samples in similarity set is far less than the ones in dissimila...
详细信息
ISBN:
(纸本)9781479914821
Similarity learning is one of the most fundamental notions in machine learning and pattern recognition. In real-world problems, the number of the paired-samples in similarity set is far less than the ones in dissimilarity set. In other word, there is an unbalanced problem in the paired-samples of similarity learning. This paper presents a scheme of SVM ensemble to solve it. In our scheme, we randomly select some of samples to construct paired-samples, not producing all the paired-samples, and introduces multiple classifiers to obtain higher stability and reliability. As a result, the SVM ensemble can effectively decrease the number of paired-samples in similarity learning and solve the unbalanced data learning to some degree. In the experiments, the SVM ensemble is compared with some classic unbalanced learning algorithms. The results on classification tasks show that the SVM ensemble gains better performance.
This paper presents a novel multiobjective constraint handling approach, named as MOEA/D-CDP-ID, to tackle constrained optimization problems. In the proposed method, two mechanisms, namely infeasibility driven (ID) an...
详细信息
Independent spanning trees (ISTs for short) in networks have applications such as reliable communication protocols, the multi-node broadcasting, one-to-all broadcasting, reliable broadcasting, and secure message distr...
详细信息
Independent spanning trees (ISTs for short) in networks have applications such as reliable communication protocols, the multi-node broadcasting, one-to-all broadcasting, reliable broadcasting, and secure message distribution. However, it is an open problem whether there are n ISTs rooted at any node in any n connected network with n 5. In this paper, we consider the construction of ISTs in a family of hypercube variants, called conditional BC networks. A recursive algorithm based on two common rules is proposed to construct n ISTs rooted at any node in any n -dimensional conditional BC network n X . We also show that our constructive method is adaptive to not only the existing hypercube variants, but also some other ones.
The portrait region of portrait photo may be too dark due to backlight during the process of photo taking. Aiming at this problem, we propose a new image enhancement method based on histogram-based contrast method(HC)...
详细信息
The portrait region of portrait photo may be too dark due to backlight during the process of photo taking. Aiming at this problem, we propose a new image enhancement method based on histogram-based contrast method(HC) image saliency detection. Portrait area in portrait photo is the most salient region, thus we first use HC to measure saliency and then extract the portrait area from the portrait photo with the help of saliency map. We simply enhance the portrait region, keeping the background unchanged. Experiment results prove that proposed algorithm is able to compress the dynamic range of the original image and yield pleasing enhancement result.
Ancient language manuscripts constitute a key part of the cultural heritage of mankind. As one of the most important languages, Chinese historical calligraphy work has contributed to not only the Chinese cultural heri...
详细信息
Content distribution schemes for Video on Demand (VoD) systems, based on the peer-to-peer (P2P) technology, have attracted more and more attention. Recently, people mainly focus on the latency performance, security, i...
详细信息
ISBN:
(纸本)9781479954599
Content distribution schemes for Video on Demand (VoD) systems, based on the peer-to-peer (P2P) technology, have attracted more and more attention. Recently, people mainly focus on the latency performance, security, interaction, scalability, and so on. We propose a new network topology model - Similarity Crossed Cube(S-CQ for short), which combines with the feature of crossed cube and establishes multiple independent spanning trees for data distribution in the layer. This network model processes the properties such as good self-organization, delay, etc. The simulation results also show that it can effectively reduce the playback delay and maintain a low delay. The S-CQ network model can provide good quality of VoD service and effectively improve the user experience.
In this paper,we firstly present a kind of models for truly concurrent systems named parallel run *** we present a parallel interval logic,called PIL,which is an extension of interval ***,we give an algorithm of model...
详细信息
In this paper,we firstly present a kind of models for truly concurrent systems named parallel run *** we present a parallel interval logic,called PIL,which is an extension of interval ***,we give an algorithm of model checking PIL on parallel run structures.
暂无评论