检索结果-内蒙古大学图书馆

hyper-parameter optimization of deep learning architectures using artificial bee colony (ABC) algorithm for high performance real-time automatic colorectal cancer (CRC) polyp detection

引用

APPLIED INTELLIGENCE 2023年第12期53卷 15603-15620页

作者： Karaman, Ahmet Karaboga, Dervis Pacal, Ishak Akay, Bahriye Basturk, Alper Nalbantoglu, Ufuk Coskun, Seymanur Sahin, Omur Acibadem Hosp Dept Gastroenterol Kayseri Turkey Erciyes Univ Engn Fac Dept Comp Engn Kayseri Turkey Erciyes Univ Artificial Intelligence & Big Data Applicat & Res Kayseri Turkey Igdir Univ Engn Fac Dept Comp Engn Igdir Turkey

Colorectal cancer (CRC) is one of the most common and malignant types of cancer worldwide. Colonoscopy, considered the gold standard for CRC screening, allows immediate removal of polyps, which are precursors to CRC. Many computer-aided diagnosis systems (CADs) have been proposed for automatic polyp detection. Most of these systems are based on traditional machine learning algorithms and their generalization ability, sensitivity and specificity are limited. On the other hand, with the widespread use of deep learning algorithms in medical image analysis and the successful results in the analysis of colonoscopy images, especially in the early and accurate detection of polyps, these problems are eliminated in recent years. In short, deep learning algorithms and applications have gained a critical role in CAD systems for real-time autonomous polyp detection. Here, we make significant improvements to object detection algorithms to improve the performance of CAD-based real-time polyp detection systems. We integrate the artificial bee colony algorithm (ABC) into the YOLO algorithm to optimize the hyper-parameters of YOLO-based algorithms. The proposed method can be easily integrated into all YOLO algorithms such as YOLOv3, YOLOv4, Scaled-YOLOv4, YOLOv5, YOLOR and YOLOv7. The proposed method improves the performance of the Scaled-YOLOv4 algorithm with an average of more than 3% increase in mAP and a more than 2% improvement in F1 value. In addition, the most comprehensive study is conducted by evaluating the performance of all existing models in the Scaled-YOLOv4 algorithm (YOLOv4s, YOLOv4m, YOLOV4-CSP, YOLOv4-P5, YOLOV4-P6 and YOLOv4-P7) on the novel SUN and PICCOLO polyp datasets. The proposed method is the first study for the optimization of YOLO-based algorithms in the literature and makes a significant contribution to the detection accuracy.

关键词： Colorectal cancer Deep learning hyper-parameter optimization Artificial bee colony Real-time polyp detection YOLOv4

来源：评论

学校读者我要写书评

暂无评论

hyper-parameter optimization based nonlinear multistate deterioration modeling for deterioration level assessment and remaining useful life prognostics

引用

RELIABILITY ENGINEERING & SYSTEM SAFETY 2017年 167卷 517-526页

作者： Chen, Gaige Chen, Jinglong Zi, Yanyang Miao, Huihui Xi An Jiao Tong Univ State Key Lab Mfg & Syst Engn Xian Shaanxi Peoples R China

Complex equipment deterioration refers to a nonlinear multistate deterioration process, where the deterioration curve may not follow a typical shape such as exponential or linear function. A general solution is presented to nonlinear multistate deterioration modeling for deterioration level assessment and remaining useful life prognostics under no-label lifetime data including multi signals. In the solution, a three layer nonlinear multistate deterioration model of complex equipment is established based on hyper-parameter optimization. hyper-parameter I and M, which determine the first two layers, are optimized by the proposed unsupervised extraction method based on greedy kernel principal components analysis and the improved Mann-Kendall criterion, respectively. As a determinant of the third layer, hyper-parameter N is optimized by the improved Bayesian information criterion to obtain optimized model, when parameters have been estimated under each alternative model structure at different N. The no-label lifetime dataset of turbofan engines are adopted for case study, and more accurate deterioration level and remaining useful life are obtained. The results verify the effectiveness of the presented solution. The study indicates that: nonlinearity makes an important effect on multistate deterioration modeling through hyper-parameters;the solution deals with nonlinearity in a systematic manner by hyper-parameter optimization of three layers. (C) 2017 Elsevier Ltd. All rights reserved.

关键词： Remaining useful life Multistate deterioration Nonlinearity hyper-parameter optimization Complex equipment

来源：评论

学校读者我要写书评

暂无评论

hyper-parameter optimization of Multi-attention Recurrent Neural Network for Battery State-of-Charge Forecasting 19th

Hyper-parameter Optimization of Multi-attention Recurrent Ne...

引用

19th EPIA Conference on Artificial Intelligence (EPIA)

作者： Mashlakov, Aleksei Tikka, Ville Lensu, Lasse Romanenko, Aleksei Honkapuro, Samuli LUT Univ Yliopistonkatu 34 Lappeenranta 53850 Finland

ISBN: (纸本)9783030302412;9783030302405

In the past years, a rapid deployment of battery energy storage systems for diverse smart grid services has been seen in electric power systems. However, a cost-effective and multi-objective application of these services necessitates a utilization of forecasting methods for a development of efficient capacity allocation and risk management strategies over the uncertainty of battery state-of-charge. The aim of this paper is to assess the tuning efficiency of multi-attention recurrent neural network for multi-step forecasting of battery state-of-charge under provision of primary frequency control. In particular, this paper describes hyperparameter optimization of the network with a tree-structured parzen estimator and compares such optimization performance with random and manual search on a simulated battery state-of-charge dataset. The experimental results demonstrate that the tree-structured parzen estimator enables 0.6% and 1.5% score improvement for the dataset compared with the random and manual search, respectively.

关键词： Battery state-of-charge hyper-parameter optimization Multi-attention neural network Random search Tree parzen estimator

来源：评论

学校读者我要写书评

暂无评论

hyper-parameter optimization for Latent Spaces 1

引用

21st Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD)

作者： Veloso, Bruno Caroprese, Luciano Konig, Matthias Teixeira, Sonia Manco, Giuseppe Hoos, Holger H. Gama, Joao Portucalense Univ Porto Portugal Leiden Univ Leiden Netherlands Univ Porto Porto Portugal Univ British Columbia Vancouver BC Canada ICAR CNR Arcavacata Di Rende Italy LIAAD INESC TEC Porto Portugal

ISBN: (数字)9783030865238

ISBN: (纸本)9783030865238;9783030865221

We present an online optimization method for time-evolving data streams that can automatically adapt the hyper-parameters of an embedding model. More specifically, we employ the Nelder-Mead algorithm, which uses a set of heuristics to produce and exploit several potentially good configurations, from which the best one is selected and deployed. This step is repeated whenever the distribution of the data is changing. We evaluate our approach on streams of real-world as well as synthetic data, where the latter is generated in such way that its characteristics change over time (concept drift). Overall, we achieve good performance in terms of accuracy compared to state-of-the-art AutoML techniques.

关键词： AutoML hyper-parameter optimization Latent spaces Nelder-Mead algorithm SMAC Recommender systems

来源：评论

学校读者我要写书评

暂无评论

hyper-parameter optimization OF DEEP CONVOLUTIONAL NETWORKS FOR OBJECT RECOGNITION

HYPER-PARAMETER OPTIMIZATION OF DEEP CONVOLUTIONAL NETWORKS ...

引用

IEEE International Conference on Image Processing (ICIP)

作者： Talathi, Sachin S. Qualcomm Res Ctr 5775 Morehouse Dr San Diego CA 92121 USA

ISBN: (纸本)9781479983391

Recently sequential model based optimization (SMBO) has emerged as a promising hyper-parameter optimization strategy in machine learning. In this work, we investigate SMBO to identify architecture hyper-parameters of deep convolution networks (DCNs) object recognition. We propose a simple SMBO strategy that starts from a set of random initial DCN architectures to generate new architectures, which on training perform well on a given dataset. Using the proposed SMBO strategy we are able to identify a number of DCN architectures that produce results that are comparable to state-of-the-art results on object recognition benchmarks.

关键词： hyper-parameter optimization deep convolution networks sequential model based optimization

来源：评论

学校读者我要写书评

暂无评论

hyper-parameter optimization FOR CONVOLUTIONAL NEURAL NETWORK COMMITTEES BASED ON EVOLUTIONARY ALGORITHMS 24

HYPER-PARAMETER OPTIMIZATION FOR CONVOLUTIONAL NEURAL NETWOR...

引用

24th IEEE International Conference on Image Processing (ICIP)

作者： Bochinski, Erik Senst, Tobias Sikora, Thomas Tech Univ Berlin Commun Syst Grp Berlin Germany

ISBN: (纸本)9781509021758

In a broad range of computer vision tasks, convolutional neural networks (CNNs) are one of the most prominent techniques due to their outstanding performance. Yet it is not trivial to find the best performing network structure for a specific application because it is often unclear how the network structure relates to the network accuracy. We propose an evolutionary algorithm-based framework to automatically optimize the CNN structure by means of hyper-parameters. Further, we extend our framework towards a joint optimization of a committee of CNNs to leverage specialization and cooperation among the individual networks. Experimental results show a significant improvement over the state-of-the-art on the well-established MNIST dataset for hand-written digits recognition.

关键词： Image Classification Convolutional Neural Network Evolutionary Algorithm MNIST hyper-parameter optimization

来源：评论

学校读者我要写书评

暂无评论

hyper-parameter optimization for Deep Learning by Surrogate-based Model with Weighted Distance Exploration

Hyper-Parameter Optimization for Deep Learning by Surrogate-...

引用

IEEE Congress on Evolutionary Computation (IEEE CEC)

作者： Li, Zhenhua Shoemaker, Christine A. Nanjing Univ Aeronaut & Astronaut Sch Comp Sci & Technol Nanjing Peoples R China Natl Univ Singapore Dept Ind Syst Engn Singapore Singapore

ISBN: (纸本)9781728183923

To improve deep neural net hyper-parameter optimization we develop a deterministic surrogate optimization algorithm as an efficient alternative to Bayesian optimization. A deterministic Radial Basis Function (RBF) surrogate model is built to interpolate previously evaluated points, and this surrogate model is incrementally updated in each iteration. The stochastic algorithm CMA-ES is used to search the acquisition function based on the surrogate. The acquisition function at a point is based on a weighted average of the surrogate at x and the minimum distance from x to a previously evaluated point. We evaluate the proposed algorithm RBF-CMA on hyper-parameter optimization tasks for deep convolutional neural networks on datasets of CIFAR-10, SVHN, and CIFAR-100. We show that RBF-CMA achieves a promising performance especially when the search space dimension is high in comparison to other algorithms including GP-EI, GP-LCB, and SMBO.

关键词： hyper-parameter optimization deep neural networks surrogate optimization radial basis function

来源：评论

学校读者我要写书评

暂无评论

hyper-parameter optimization OF DEEP LEARNING MODELS FOR COMPRESSOR AIR LEAK PREDICTION IN A GAS TURBINE

HYPER-PARAMETER OPTIMIZATION OF DEEP LEARNING MODELS FOR COM...

引用

ASME Power Conference (Power)

作者： Nogueras-Rivera, Diego I. Mojica-Vazquez, Lemuel Bonilla-Alvarado, Harry Bryden, Kenneth M. Tucker, David Traverso-Aviles, Luis M. Aponte-Roa, Diego A. Univ Ana G Mendez Elect & Comp Engn Dept San Juan PR 00926 USA Ames Lab Decis Sci Program Ames IA USA US DOE Natl Energy Technol Lab Washington DC USA Univ Ana G Mendez Mech Engn Dept San Juan PR USA

ISBN: (纸本)9780791885826

Gas turbine systems are widely used in the power industry because they provide continuous and reliable power to the electrical grid. One of the main concerns for implementing gas turbine systems is the maintenance costs. Therefore, predictive maintenance methods driven by Deep Learning (DL) models present an opportunity to extract important information and knowledge from the process data to minimize maintenance costs and reduce equipment failure rates. A previous study aimed to benchmark various state-of-the-art DL models for predicting compressor air leak with multivariate time-series data from a modified recuperated gas turbine system. However, the brute-force approach used to select the hyper-parameters of the DL models could be improved. This paper aims to address the hyper-parameter optimization process of the best performers for predicting the next future time-step: GRU-LSTM, Sequential CNNLSTM, and BI-LSTM. In addition, a BI-GRU model was implemented and a common grid search algorithm was combined with proposed algorithms for automating the selection of hyper-parameter values to build the DL models. The datasets were provided from experiments conducted at the U.S. Department of Energy's National Energy Technology Laboratory (NETL) Hybrid Performance (hyper) Facility. Results suggest better performance can be obtained from the already good performing benchmarked models;however, reproducing the best results for some models may take more training cycles. The BI-GRU model exhibited the most reproducible results across all tests.

关键词： Deep Learning Failure Prediction Gas Turbines hyper-parameter optimization Time Series

来源：评论

学校读者我要写书评

暂无评论

hyper-parameter optimization for Improving the Performance of Grammatical Evolution

Hyper-Parameter Optimization for Improving the Performance o...

引用

IEEE Congress on Evolutionary Computation (IEEE CEC)

作者： Wang, Hao Lou, Yitan Back, Thomas Leiden Univ LIACS Niels Bohrweg 1 Leiden Netherlands

ISBN: (纸本)9781728121536

State-of-the-art Grammatical Evolution systems such as PonyGE2 have a number of hyper-parameters that control the behavior of the internal evolutionary algorithm for evolving the representations of programs. In this paper, a variant of the efficient global optimization (EGO) algorithm is applied for optimizing these hyper-parameters of the PonyGE2-system. This approach is tested on four test problems used in the Grammatical Evolution community: StringMatch, symbolic regression (the 'Vladislavleva-4' problem), bank note classification and the so-called Pymax task. The experimental results show that the average performance of the GE system is improved significantly (between 25% and 168%) on all of the test problems. In addition, the resulting overall best hyper-parameter settings are substantially different from the defaults used in PonyGE2.

关键词： Grammatical Evolution hyper-parameter optimization

来源：评论

学校读者我要写书评

暂无评论

A new hyper-parameter optimization method for machine learning in fault classification

引用

APPLIED INTELLIGENCE 2023年第11期53卷 14182-14200页

作者： Ye, Xingchen Gao, Liang Li, Xinyu Wen, Long Huazhong Univ Sci & Technol State Key Lab Digital Mfg Equipment & Technol 1037 Luoyu Rd Wuhan 430074 Peoples R China China Univ Geosci Sch Mech Engn & Elect Informat 388 Lumo Rd Wuhan 430074 Peoples R China

Accurate bearing fault classification is essential for the safe and stable operation of rotating machinery. The success of Machine Learning (ML) in fault classification is mainly dependent on efficient features and the optimal pre-defined hyper-parameters. Various hyper-parameter optimization (HPO) methods have been proposed to tune the ML algorithms' hyper-parameters in low dimensions but ignore the hyper-parameters of Feature Engineering (FE). The hyper-parameter dimension is high because both FE and the ML algorithm contain many hyper-parameters. This paper proposed a new HPO method for high dimensions based on dimension reduction and partial dependencies. Firstly, the whole hyper-parameter space is separated into two subspaces of FE and the ML algorithm to reduce time consumption. Secondly, the sensitive intervals of hyperparameters can be recognized by partial dependencies due to the nonlinearity of the relationship between the hyperparameters. Then HPO is conducted in intervals to acquire more satisfactory accuracy. The proposed method is verified on three OpenML datasets and the CWRU bearing dataset. The results show that it can automatically construct efficient domain features and outperforms traditional HPO methods and famous ML algorithms. The proposed method is also very time efficient.

关键词： hyper-parameter optimization Fault classification Dimension reduction Partial dependencies

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：