Target propagation in deep neuralnetworks aims at improving the learning process by determining target outputs for the hidden layers of the network. To date, this has been accomplished via gradient-descent or relying...
详细信息
ISBN:
(纸本)9783319999784;9783319999777
Target propagation in deep neuralnetworks aims at improving the learning process by determining target outputs for the hidden layers of the network. To date, this has been accomplished via gradient-descent or relying on autoassociative networks applied top-to-bottom in order to synthesize targets at any given layer from the targets available at the adjacent upper layer. This paper proposes a different, error-driven approach, where a regular feed-forwardneural net is trained to estimate the relation between the targets at layer l and those at layer l - 1 given the error observed at layer l. The resulting algorithm is then combined with a pre-training phase based on backpropagation, realizing a proficuous "refinement" strategy. Results on the MNIST database validate the feasibility of the approach.
Matrix neural gas has been proposed as a mathematically well-founded extension of neural gas networks to represent data in terms of prototypes and local principal components in a smooth way. The additional information...
详细信息
ISBN:
(纸本)9783642121586
Matrix neural gas has been proposed as a mathematically well-founded extension of neural gas networks to represent data in terms of prototypes and local principal components in a smooth way. The additional information provided by local principal directions can directly be combined with charting techniques such that a nonlinear embedding of a data manifold into low dimensions results for which an explicit function as well as an approximate inverse exists. In tins paper, we show that these ingredients can be used to embed dynamic textures in low dimensional spaces such that, together with a traversing technique in the low dimensional representation, efficient dynamic texture synthesis can be obtained.
Last decade advances in Deep Learning methods lead to sensible improvements in state of the art results in many real world applications, thanks to the exploitation of particular artificialneuralnetworks architecture...
详细信息
ISBN:
(纸本)9783319999784;9783319999777
Last decade advances in Deep Learning methods lead to sensible improvements in state of the art results in many real world applications, thanks to the exploitation of particular artificialneuralnetworks architectures. In this paper we present an investigation of the application of such kind of structures to a Video Surveillance case of study, in which the special nature and the small amount of available data increases the difficulties during the training phase. The analyzed scenario involves the protection of Automatic Teller Machines (ATM), representing a sensitive problem in the world of both banking and public security. Because of the critical issues related to this environment, even apparently small improvements in either accuracy or responsiveness of surveillance systems can produce a fundamental contribution. Even if the experimentation has been reproduced in an artificial scenario, the results show that the implemented architecture is able to classify depth data in real-time on an embedded system, detecting all the test attacks in a few seconds.
Supervised learning models most commonly use crisp labels for classifier training. Crisp labels fail to capture the data characteristics when overlapping classes exist. In this work we attempt to compare between learn...
详细信息
ISBN:
(纸本)3540379517
Supervised learning models most commonly use crisp labels for classifier training. Crisp labels fail to capture the data characteristics when overlapping classes exist. In this work we attempt to compare between learning using soft and hard labels to train K-nearest neighbor classifiers. We propose a new technique to generate soft labels based on fuzzy-clustering of the data and fuzzy relabelling of cluster prototypes. Experiments were conducted on five data sets to compare between classifiers that learn using different types of soft labels and classifiers that learn with crisp labels. Results reveal that learning with soft labels is more robust against label errors opposed to learning with crisp labels. The proposed technique to find soft labels from the data, was also found to lead to a more robust training in most data sets investigated.
This paper introduces a new class of sign-based training algorithms for neuralnetworks that combine the sign-based updates of the Rprop algorithm with the composite nonlinear Jacobi method. The theoretical foundation...
详细信息
This paper introduces a new class of sign-based training algorithms for neuralnetworks that combine the sign-based updates of the Rprop algorithm with the composite nonlinear Jacobi method. The theoretical foundations of the class are described and a heuristic Rprop-based Jacobi algorithm is empirically investigated through simulation experiments in benchmark pattern classification problems. Numerical evidence shows that this new modification of the Rprop algorithm exhibits improved learning speed in all cases tested, and compares favorably against the Rprop and a recently proposed modification, the improved Rprop. (c) 2005 Elsevier B.V. All rights reserved.
Unsupervised estimation of probability density functions by means of parametric mixture densities (e.g., Gaussian mixture models) may improve significantly over plain, single-density estimators in terms of modeling ca...
详细信息
ISBN:
(纸本)9783319999784;9783319999777
Unsupervised estimation of probability density functions by means of parametric mixture densities (e.g., Gaussian mixture models) may improve significantly over plain, single-density estimators in terms of modeling capabilities. Moreover, mixture densities (and even mixtures of mixture densities) may be exploited for the statistical description of phenomena whose data distributions implicitly depend on the distinct outcomes of a number of non-observable, latent states of nature. In spite of some recent advances in density estimation via neuralnetworks, no proper mixtures of neural component densities have been investigated so far. The paper proposes a first algorithm for estimating neural Mixture Densities based on the usual maximum-likelihood criterion, satisfying numerically a combination of hard and soft constraints aimed at ensuring a proper probabilistic interpretation of the resulting model. Preliminary results are presented and their statistical significance is assessed, corroborating the soundness of the approach with respect to established statistical techniques.
A novel approach to feature selection from unlabeled vector data is presented. It is based on the reconstruction of original data relationships in an auxiliary space with either weighted or omitted features. Feature w...
详细信息
ISBN:
(纸本)3540379517
A novel approach to feature selection from unlabeled vector data is presented. It is based on the reconstruction of original data relationships in an auxiliary space with either weighted or omitted features. Feature weighting, on one hand;is related to the return forces of factors in a parametric data similarity measure as response to disturbance of their optimum values. Feature omission, on the other hand, inducing measurable loss of reconstruction quality, is realized in an iterative greedy way. The proposed framework allows to apply custom data similarity measures. Here, adaptive Euclidean distance and adaptive Pearson correlation are considered, the former serving as standard reference, the latter being, usefully for intensity data. Results of the different strategies are given for chromatography and gene expression data.
Class imbalance in machine learning is a problem often found with real-world data, where data from one class clearly dominates the dataset. Most neural network classifiers fail to learn to classify such datasets corre...
详细信息
ISBN:
(纸本)9783319461823;9783319461816
Class imbalance in machine learning is a problem often found with real-world data, where data from one class clearly dominates the dataset. Most neural network classifiers fail to learn to classify such datasets correctly if class-to-class separability is poor due to a strong bias towards the majority class. In this paper we present an algorithmic solution, integrating different methods into a novel approach using a class-to-class separability score, to increase performance on poorly separable, imbalanced datasets using Cost Sensitive neuralnetworks. We compare different cost functions and methods that can be used for training Convolutional neuralnetworks on a highly imbalanced dataset of multi-channel time series data. Results show that, despite being imbalanced and poorly separable, performance metrics such as G-Mean as high as 92.8% could be reached by using cost sensitive Convolutional neuralnetworks to detect patterns and correctly classify time series from 3 different datasets.
The Multiple Classifier Systems are nowadays one of the most promising directions in patternrecognition. There are many methods of decision making by the ensemble of classifiers. The most popular are methods that hav...
详细信息
ISBN:
(纸本)9783540876557
The Multiple Classifier Systems are nowadays one of the most promising directions in patternrecognition. There are many methods of decision making by the ensemble of classifiers. The most popular are methods that have their origin in voting method, where the decision of the common classifier is a combination of individual classifiers' decisions. This work presents methods of classifier combination, where neuralnetworks plays a role of fuser block. Fusion on level of recognizer responses or values of their discriminant functions is applied. The qualities of proposed methods are evaluated via computer experiments on generated data and two benchmark databases.
The automatic extraction of the notes that were played in a digital musical signal (automatic music transcription) is an open problem. A number of techniques have been applied to solve it without concluding results. T...
详细信息
The automatic extraction of the notes that were played in a digital musical signal (automatic music transcription) is an open problem. A number of techniques have been applied to solve it without concluding results. The monotimbral polyphonic version of the problem is posed here: a single instrument has been played and more than one note can sound at the same time. This work tries to approach it through the identification of the pattern of a given instrument in the frequency domain. This is achieved using time-delay neuralnetworks that are fed with the band-grouped spectrogram of a polyphonic monotimbral music recording. The use of a learning scheme based on examples like neuralnetworks permits our system to avoid the use of an auditory model to approach this problem. A number of issues have to be faced to have a robust and powerful system, but promising results using synthesized instruments are presented. (c) 2005 Elsevier B.V. All rights reserved.
暂无评论