The authors propose a neuralnetwork (NN) model for pattern recognition which can learn new patterns without losing patterns memorized in the past. This model is called a neuralnetwork based on distance between patte...
详细信息
The authors propose a neuralnetwork (NN) model for pattern recognition which can learn new patterns without losing patterns memorized in the past. This model is called a neuralnetwork based on distance between patterns (NDP). The NDP uses the radial basis function (RBF) as the response function in place of the sigmoid function. The response function is a smooth function similar to the Gaussian base function and the probability density function. The response function learns patterns faster than the multilayered perceptron (MLP) as well as other RBF NNs. The most salient architectural feature of the NDP is self-organization by adding nodes in the output layer one by one. The NDP also varies the curve of the response function by tuning the center and the width of the response function, and separates the input space into regions for each category appropriately.
A type of recurrent artificial neuralnetwork (ANN) is studied for identification problems of modal parameter of linear structural systems. This recurrent ANN model is closely related to the analog Hopfield network op...
详细信息
A type of recurrent artificial neuralnetwork (ANN) is studied for identification problems of modal parameter of linear structural systems. This recurrent ANN model is closely related to the analog Hopfield network operated in synchronous mode where the connection strengths of the ANN are determined from the system state measurements at each sampling time. The states of neurons represent the modal parameters of the linear structural system to be identified. The recurrent ANN model preserves both the parallelism and the distributedprocessing nature of the analog Hopfield model as well as asymptotically improving the least squares estimation error. Therefore, it is a good candidate for use in real-time control as a parametric estimator, in particular, for large dimensional distributed parameter systems. Simulation results for the estimation of modal parameters of a flexible beam are presented to determine the effectiveness of this ANN architecture.
Optimal parallel schemes that minimize communication overhead for the backpropagation algorithm on neuralnetworks (NNs) are proposed. A parallel computation framework of the backpropagation algorithm is discussed, an...
详细信息
Optimal parallel schemes that minimize communication overhead for the backpropagation algorithm on neuralnetworks (NNs) are proposed. A parallel computation framework of the backpropagation algorithm is discussed, and the lower-bound of communication overhead is provided. Optimal schemes for mesh-connected and bus-connected architectures based on this framework are proposed. The scheme for the mesh-connected architecture achieves the lower-bound of communication overhead. The scheme for the bus-connected architecture reduces it to the square-root order of the number of processors, while the conventional scheme requires a linear order overhead.< >
The application of the automatic link establishment (ALE) procedures of MIL-STD-188-141A, combined with improved signal processing technology found in advanced modems, provides the basic elements to create adaptive hi...
详细信息
The application of the automatic link establishment (ALE) procedures of MIL-STD-188-141A, combined with improved signal processing technology found in advanced modems, provides the basic elements to create adaptive high frequency (HF) radio networks. Dynamic changes in ionospheric conditions and noise fluctuations make the HF network a hostile one, where links between nodes are subject to frequent failure. The addition of adaptive routing and information management enhances network robustness in this environment. This suggests the use of a distributed routing algorithm in which convergence to the shortest path is of primary concern. However, routing decisions derived from such distributed processes exhibit an inherent uncertainty due to the randomness of link failures and the latency of network performance information. The authors describe predictions of a computer simulation of a wide area HF radio network that invokes ALE procedures, adaptive routing, and information management protocols. Aspects include the impact of modem interleaver delay time, encryption synchronization delay, management overhead, and message handling on throughput and network latency. Recommendations are presented with respect to the application of statistical neuralprocessing to improve network management in this environment.< >
Proposes a PDAI&CD architecture aimed at constructing natural inference systems. The kernel consists of a mutually associative neuralnetwork which processes numerical patterns and of a logical system processing s...
详细信息
Proposes a PDAI&CD architecture aimed at constructing natural inference systems. The kernel consists of a mutually associative neuralnetwork which processes numerical patterns and of a logical system processing symbols. The associative part calls on context-dependent free-association of concepts based on the relations of concepts acquired from a dynamically changing outer world. In the logical part of the architecture, the results obtained by the neuralnetwork are checked, and emerging contradictions create feedback to the associative network and thus find a final optimum solution. WAVE, an implemented system, is introduced, and the authors show its application to the problem of ambiguity resolution in natural language understanding.
Load-balancing systems use workload indices to dynamically schedule jobs. We present a novel method of automatically learning such indices. Our approach uses comparator neuralnetworks, one per site, which learn to pr...
详细信息
Load-balancing systems use workload indices to dynamically schedule jobs. We present a novel method of automatically learning such indices. Our approach uses comparator neuralnetworks, one per site, which learn to predict the relative speedup of an incoming job using only the resource-utilization patterns observed prior to the job's arrival. Our load indices combine information from the key resources of contention: CPU, disk, network, and memory.
Different learning models employ different styles of generalization on novel inputs. The need for multiple styles of generalization to support a broad application base is discussed. The priority ASOCS (PASOCS) model (...
详细信息
Different learning models employ different styles of generalization on novel inputs. The need for multiple styles of generalization to support a broad application base is discussed. The priority ASOCS (PASOCS) model (priority adaptive self-organizing concurrent system) is presented as a potential platform which can support multiple generalization styles. PASOCS is an adaptive network composed of many simple computing elements operating asynchronously and in parallel. PASOCS can operate in either a data processing mode or a learning mode. During data processing mode, the system acts as a parallel hardware circuit. During learning mode, PASOCS incorporates rules, with attached priorities, which represent the application being learned. Learning is accomplished in a distributed fashion in time logarithmic in the number of rules. The new model has significant learning time and space complexity improvements over previous models.< >
A chip based on a new scalable parallel systolic VLSI architecture is presented for executing the compute-bound algorithmic primitives used by search and learning algorithms in neuralnetworks and low-level signal pro...
详细信息
A chip based on a new scalable parallel systolic VLSI architecture is presented for executing the compute-bound algorithmic primitives used by search and learning algorithms in neuralnetworks and low-level signal processing. The architecture combines high performance with a high grade of flexibility for all types and sizes of neuralnetworks. The processor chip can be connected to form 1-D and 2-D arrays. By offering an accuracy of 16 b for input and 47 b for output data, the chip achieves 800M connections/s at 50 MHz. It is realized in 1.0-/spl mu/m CMOS (610K transistors on 13.7 /spl times/ 13.7 mm/sup 2/) and has a total data bandwidth of 10.9 Gb/s.
This paper describes a framework for implementing neuralnetworks on massively parallel machines. The framework is generic and applies to a range of neuralnetworks (Multi Layer Perception, Competitive Learning, Self-...
详细信息
ISBN:
(纸本)0818626720
This paper describes a framework for implementing neuralnetworks on massively parallel machines. The framework is generic and applies to a range of neuralnetworks (Multi Layer Perception, Competitive Learning, Self-Organizing Map, etc.) as well as a range of massively parallel machines (Connection Machine, distributed Array Processor, MasPar). It consists of two phases: an abstract decomposition of neuralnetworks and a machine specific decomposition. The abstract decomposition identifies the parallelism implemented by neuralnetworks, and provides alternative distribution schemes according to the required exploitation of parallelism. The machine specific decomposition considers the relevant machine criteria, and integrates these with the result of the abstract decomposition to form a `decision' system. This system formalizes the relative gain of each distribution scheme according to neuralnetwork and machine criteria. It then identifies their possible optimizations. Finally, it computes and ranks the absolute speed up of each distribution scheme.
Adaptive extraction of principal components of a vector stochastic process is a topic currently receiving much attention [l]-[8]. In this paper, we propose a new learning algorithm implemented on a neural-like network...
详细信息
暂无评论