检索结果-内蒙古大学图书馆

27th European Signal Processing Conference (EUSIPCO)

作者： Pantazis, Yannis Paul, Dipjyoti Fasoulakis, Michail Stylianou, Yannis FORTH Inst Appl & Computat Math Iraklion Greece Univ Crete Dept Comp Sci Iraklion Greece FORTH Inst Comp Sci Iraklion Greece

ISBN: (纸本)9789082797039

The impressive success of Generative Adversarial Networks (GANs) is often overshadowed by the difficulties in their training Despite the continuous efforts and improvements, there are still open issues regarding their convergence properties. In this paper, we propose a simple training variation where suitable weights are defined and assist the training of the Generator. We provide theoretical arguments which indicate that the proposed algorithm is better than the baseline algorithm in the sense of creating a stronger Generator at each iteration. Performance results showed that the new algorithm is more accurate and converges faster in both synthetic and image datasets resulting in improvements ranging between 5% and 50%.

关键词： Generative adversarial networks multiplicative weight update method training algorithm

来源：评论

学校读者我要写书评

暂无评论

Architecture optimization, training convergence and network estimation robustness of a fully connected recurrent neural network

Architecture optimization, training convergence and network ...

引用

作者： Wang, Xiaoyu Clemson University

学位级别：Ph.D.

Recurrent neural networks (RNN) have been rapidly developed in recent years. Applications of RNN can be found in system identification, optimization, image processing, pattern reorganization, classification, clustering, memory association, etc. In this study, an optimized RNN is proposed to model nonlinear dynamical systems. A fully connected RNN is developed first which is modified from a fully forward connected neural network (FFCNN) by accommodating recurrent connections among its hidden neurons. In addition, a destructive structure optimization algorithm is applied and the extended Kalman filter (EKF) is adopted as a network’s training algorithm. These two algorithms can seamlessly work together to generate the optimized RNN. The enhancement of the modeling performance of the optimized network comes from three parts: (1) its prototype - the FFCNN has advantages over multilayer perceptron network (MLP), the most widely used network, in terms of modeling accuracy and generalization ability; (2) the recurrency in RNN network make it more capable of modeling non-linear dynamical systems; and (3) the structure optimization algorithm further improves RNN’s modeling performance in generalization ability and robustness. Performance studies of the proposed network are highlighted in training convergence and robustness. For the training convergence study, the Lyapunov method is used to adapt some training parameters to guarantee the training convergence, while the maximum likelihood method is used to estimate some other parameters to accelerate the training process. In addition, robustness analysis is conducted to develop a robustness measure considering uncertainties propagation through RNN via unscented transform. Two case studies, the modeling of a benchmark non-linear dynamical system and a tool wear progression in hard turning, are carried out to testify the development in this dissertation. The work detailed in this dissertation focuses on the creation of: (1) a new

关键词： Network Optimization Network Robustness Recurrent Neural Network training algorithm training Convergence

来源：评论

学校读者我要写书评

暂无评论

The quick method of neural network training

The quick method of neural network training

引用

International Conference on Modern Problems of Radio Engineering, Telecommunications and Computer Science (TCSET 2002)

作者： Dubrovin, V Subbotin, S Zaporozhye Natl Tech Univ UA-69063 Zaporozhe Ukraine

The algorithm for training of neural networks allowing to increase convergence of network training is developed. The results of experiments on practical problems solving on the basis of proposed algorithm are shown.

ISBN: (纸本)9665532340

关键词： neural network training algorithm

来源：评论

学校读者我要写书评

暂无评论

Robust training of Microwave Neural Network Models Using Combined Global/Local Optimization Techniques

Robust Training of Microwave Neural Network Models Using Com...

引用

2008 IEEE MTT-S International Microwave Symposium Digest

作者： Ninomiya, Hiroshi Wan, Shan Kabir, Humayun Zhang, Xin Zhang, Q. J. Shonan Inst Technol Dept Informat Sci Fujisawa Kanagawa 2518511 Japan Carleton Univ Dept Elect Ottawa ON K1S 5B6 Canada

ISBN: (纸本)9781424417803

We present a new technique for training microwave neural network models. The proposed technique combines quasi-Newton algorithm with a recent global optimization algorithm called Particle Swarm Optimization (PSO). The quasi-Newton process for searching optimal solutions is incorporated into PSO to speed up local search, while the PSO performs global search avoid being trapped in local minima of training. The overall algorithm iterates between quasi-Newton and PSO. Neural network training for waveguide and microstrip examples are presented, demonstrating that the proposed algorithm achieves more accurate models than the conventional gradient based technique and the conventional PSO.

关键词： Global optimization neural networks particle swarm optimization training algorithm

来源：评论

学校读者我要写书评

暂无评论

A training method for SpikeProp without redundant spikes -Removing unnecessary sub-connections during training- 12

A training method for SpikeProp without redundant spikes -Re...

引用

12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)

作者： Nakayama, Takutoshi Matsumoto, Takashi Takase, Haruhiko Kawanaka, Hiroharu Tsuruoka, Shinji Mie Univ Grad Sch Engn Tsu Mie 5148507 Japan Mie Univ Tsu Mie 5148507 Japan

ISBN: (纸本)9781509040933

SpikeProp, which is proposed by Bohte and extended by Booij, is a type of multi-layer networks of spiking neurons. Our research group has proposed a training algorithm for SpikeProp without redundant output spikes. However, its performance is sensitive to the initial network structure, such as the number of hidden units, the number of sub-connections, and their delays. In this article, we discuss the problem, especially the number of sub-connections. And we propose a method to remove unnecessary sub-connections during training. By simple experiments, we show that the method brings less dependency of training performance on the number of initial sub-connections.

关键词： Spiking Neural Network SpikeProp training algorithm Time Series Signal Processing

来源：评论

学校读者我要写书评

暂无评论

Efficient Serial and Parallel SVM training using Coordinate Descent

Efficient Serial and Parallel SVM Training using Coordinate ...

引用

IEEE Symposium on Computational Intelligence for Engineering Solutions (CIES)

作者： Liossis, Emmanuel Natl Tech Univ Athens Sch Elect & Comp Engn Intelligent Syst Lab Athens Greece

ISBN: (纸本)9781467358514

Eliminating the bias term of the Support Vector Machine (SVM) classifier permits substancial simplification to training algorithms. Using this elimination, the optimization invloved in training can be decomposed to update as low as one coordinate at a time. This paper explores two directions of improvements which stem from this simplification. The first one is about the options available for choosing the coordinate to optimize during each optimization iteration. The second one is about the parallelization schemes which the simplified optimization facilitates.

关键词： SVM training algorithm parallel

来源：评论

学校读者我要写书评

暂无评论

Evaluating the training Dynamics of a CMOS based Synapse

Evaluating the Training Dynamics of a CMOS based Synapse

引用

International Joint Conference on Neural Networks (IJCNN)

作者： Ghani, Arfan McDaid, Liam J. Belatreche, Ammar Kelly, Peter Hall, Steve Dowrick, Tom Huang, Shou Marsland, John Smith, Andy Univ Ulster Intelligent Syst Res Ctr Magee Campus Derry BT48 7JL North Ireland Univ Liverpool Liverpool L693GJ Merseyside England

ISBN: (纸本)9781424496365

Recent work by the authors proposed compact low power synapses in hardware, based on the charge-coupling principle, that can be configured to yield a static or dynamic response. The focus of this work is to investigate the training dynamics of these synapses. Empirical models of the Post Synaptic Response (PSP), derived from hardware simulations, were developed and subsequently embedded into the MATLAB environment. A network of these synapses was then used to solve a benchmark problem using a well established training algorithm where the performance metric was convergence time, accuracy and weight range;the Spike Response Model (SRM) was used to implement point neurons. Results are presented and compared with standard synaptic responses.

关键词： CMOS based synapse CMOS logic circuits Equations Firing Hardware MATLAB environment Mathematical model Neurons SRM Silicon training charge-coupling principle hardware simulations learning (artificial intelligence) neural nets post synaptic response spike response model training algorithm

来源：评论

学校读者我要写书评

暂无评论

Using Particle Swarm Optimization in training Neural Network for Indoor Field Strength Prediction

Using Particle Swarm Optimization in Training Neural Network...

引用

51st International Symposium ELMAR

作者： Vilovic, Ivan Burum, Niksa Milic, Dorde Univ Dubrovnik Dubrovnik Croatia

ISBN: (纸本)9789537044107

This paper presents a comparison of results obtained from neural network training by backpropagation and particle swarm optimization (PSO) algorithms. The neural network model has been developed for field strength prediction in indoor environments. It has been already shown for neural networks as powerful tool in RF propagation prediction. It is very important to choose proper algorithm for training a neural network, so we compared BP training algorithms: gradient descent method and Levenberg- Marquardt algorithm with PSO algorithm. PSO algorithm has been shown as powerful method for global optimization in several applications. A floor of university building in Dubrovnik has been used as case for simulation and measurement of signal strength. The results show that the neural network weights converge faster with PSO than with standard BP algorithms.

关键词： Neural network Multilayer Perceptron training algorithm Backpropagation algorithm Gradient descent algorithm Levenberg-Marquardt algorithm Particle swarm optimization

来源：评论

学校读者我要写书评

暂无评论

A Novel Quasi-Newton-Based training Using Nesterov's Accelerated Gradient for Neural Networks 25th

A Novel Quasi-Newton-Based Training Using Nesterov's Acceler...

引用

25th International Conference on Artificial Neural Networks (ICANN)

作者： Ninomiya, Hiroshi Shonan Inst Technol Dept Informat Sci Fujisawa Kanagawa Japan

ISBN: (纸本)9783319447810;9783319447803

Neural networks have been recognized as a useful tool for the function approximation problems with high-nonlinearity [1]. training is the most important step in developing a neural network model. Gradient based algorithms are popularly used for the training. The popular methods are first-order methods so called Steepest Gradient (SG), Classical Momentum (CM), Nesterov’s Accelerated Gradient (NAG) methods and a more dedicated method such as RPROP. On the other hand, quasi-Newton (QN) method which is one of the most efficient optimization techniques with super-linear convergence is also widely utilized for more complicated problems. However, when applied to highly nonlinear function modeling, the above methods even QN still converges too slowly and optimization error cannot be effectively reduced within finite time. This paper describes a novel acceleration technique of QN using Nesterov’s accelerated gradient [2]. The proposed algorithm is referred to as Nesterov’s accelerated quasi-Newton (NAQ) method. The update equation of the approximated matrix of Hessian is mathematically derived from the quadratic approximation of error function. The Hessian is approximated using both of the normal gradient and the Nesterov’s accelerated one in NAQ. NAQ is a technique for accelerating QN that accumulates an update vector in directions of persistent reduction in the objective across iterations. As a result, the iteration during the NAQ training can be shortened without loss of the strong ability to search a global minimum in QN. The proposed algorithm is demonstrated through the computer simulations for the benchmark problems with high-nonlinearity compared with SG, CM, NAG, RPROP and QN. From the simulation results it is shown that NAQ is faster than the conventional methods without compromising quality of training solutions. © Springer International Publishing Switzerland 2016.

关键词： Neural networks training algorithm Nesterov's accelerated gradient method Quasi-Newton method

来源：评论

学校读者我要写书评

暂无评论

Error assessment of laser cutting predictions by semi-supervised learning

引用

Journal of Central South University 2014年第10期21卷 3736-3745页

作者： Mustafa Zaidi Imran Amin Ahmad Hussain Nukman Yusoff Department of Computing Shaheed Zulfikar Ali Bhutto Institute of Science & Technology (SZABIST) Department of Nuclear Engineering King Abdulaziz University Manufacturing Systems Integration Department of Mechanical Engineering University of Malaya

Experimentation data of perspex glass sheet cutting, using CO2 laser, with missing values were modelled with semi-supervised artificial neural networks. Factorial design of experiment was selected for the verification of orthogonal array based model prediction. It shows improvement in modelling of edge quality and kerf width by applying semi-supervised learning algorithm, based on novel error assessment on simulations. The results are expected to depict better prediction on average by utilizing the systematic randomized techniques to initialize the neural network weights and increase the number of initialization. Missing values handling is difficult with statistical tools and supervised learning techniques; on the other hand, semi-supervised learning generates better results with the smallest datasets even with missing values.

关键词： semi-supervised learning training algorithm kerf width edge quality laser cutting process artificial neural network(ANN)

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：