Industrial fault detection has become more data-driven due to advancements in automated data analysis using deep learning. Such methods make it possible to extract useful features, e. g., from time series data retriev...
详细信息
Industrial fault detection has become more data-driven due to advancements in automated data analysis using deep learning. Such methods make it possible to extract useful features, e. g., from time series data retrieved from sensors, which is typically of complex nature. This allows for effective fault detection and prognostics that boost the efficiency and productivity of industrial equipment. This work explores the influence of a variety of architectural hyperparameters on the performance of one-dimensional convolutional neural networks (CNN). Using a multi-method approach, this paper focuses specifically on wide-kernel CNN models for industrial fault detection, that have proven to perform well for tasks such as classifying vibration signals retrieved from sensors. By varying hyperparameters such as the kernel size, stride and number of filters, an extensive hyperparameter space search was conducted;to identify optimal settings, we collected a total of 12,960 different combinations on three datasets into a model hyperparameter dataset, with their respective performance on the underlying fault detection task. Afterwards, this dataset was explored with follow-up analysis including statistical, feature, pattern and hyperparameter impact analysis. We find that although performance varies substantially depending on hyperparameter choices, there is no single simple strategy to optimise performance across the three datasets. However, an optimal setting in terms of performance can be found in the number of filters used in the later layers of the architecture for all datasets. Furthermore, hyperparameter importance differs across and within the datasets, and we found nonlinear relationships between hyperparameter settings and performance. Our analysis highlights key considerations when applying a wide-kernel CNN architecture to new data within the field of industrial fault detection. This supports practitioners who wish to apply and train state-of-the-art convolutional lea
The converter is a complex, high temperature, high pressure reactor with limited internal moitoring. At present, data-driven models mainly focus on the prediction differences between algorithms, and there is relativel...
详细信息
The converter is a complex, high temperature, high pressure reactor with limited internal moitoring. At present, data-driven models mainly focus on the prediction differences between algorithms, and there is relatively little analysis of the impact of different hyperparameters on prediction accuracy. Taking a 120 t converter in a Chinese steel plant as an example, this paper explores the application of particle swarm optimization-back propagation neural network (PSO-BP) in converter temperature prediction. First, the Pauta criterion or Box plot method was used to preprocess the data by prescreening. Subsequently, the influence of the activation function, learning rate, and number of hidden layer nodes of BP on the prediction accuracy of the endpoint temperature were explored. Then we investigated the influence of PSO parameters on the optimal result of BP initial value. Comparing the temperature prediction hit rate before and after optimization, the BP model has hit rates of 63.64%, 79.22%, and 87.45% within +/- 10, +/- 15, and +/- 20 degrees C, respectively, and the PSO-BP model has hit rates of 68.40%, 84.85%, and 94.81%, respectively. In comparison, PSO-BP extracts data features more accurately, has higher stability, and has better accuracy in predicting the endpoint temperature of the converter. This article establishes a particle swarm optimization-back propagation neural network (PSO-BP) model for predicting converter endpoint temperature, explores the influence of hyperparameters on the accuracy of PSO-BP prediction, reveals the principle of PSO for BP, and obtains the optimal parameter selection scheme for the model. Data validation confirms PSO-BP's effectiveness in extracting data features and achieving high prediction *** (c) 2024 WILEY-VCH GmbH
The performance of a deep learning model depends heavily on its architectural hyperparameters. However, there is often little guidance on how to tune those hyperparameters. This paper provides insights into how to tun...
详细信息
ISBN:
(纸本)9798350354102;9798350354096
The performance of a deep learning model depends heavily on its architectural hyperparameters. However, there is often little guidance on how to tune those hyperparameters. This paper provides insights into how to tune the architectural hyperparameters of a wide-kernel convolutional model for industrial fault detection, by analysing a grid search over 12,960 possible combinations of hyperparameter settings on seven benchmark datasets of vibration time series. By aggregating the results on these seven datasets, we are able to generalise across multiple industrial fault detection settings. We find that, generally speaking, the number of filters in the later convolutional layers and the hyperparameters associated with the first layer are the most important. Additionally, we analyse the relationships between hyperparameters and develop this analysis into a 'recommended sequence' for how to tune them one-at-a-time.
Predicting the oil-gas-bearing distribution of unconventional reservoirs is challenging because of the complex seismic response relationship of these reservoirs. Artificial neural network (ANN) technology has been pop...
详细信息
Predicting the oil-gas-bearing distribution of unconventional reservoirs is challenging because of the complex seismic response relationship of these reservoirs. Artificial neural network (ANN) technology has been popular in seismic reservoir prediction because of its self-learning and nonlinear expression abilities. However, problems in the training process of ANNs, such as slow convergence speed and local minima, affect the prediction accuracy. Therefore, this study proposes a hybrid prediction method that combines mutation particle swarm optimization (MPSO) and ANN (MPSO-ANN). It uses the powerful search ability of MPSO to address local optimization problems during training and improve the performance of ANN models in gas-bearing distribution prediction. Furthermore, because the predictions of ANN models require good data sources, multicomponent seismic data that can provide rich gas reservoir information are used as input for MPSO-ANN learning. First, the hyperparameters of the ANN model were analyzed, and ANNs with different structures were constructed. The initial ANN model before optimization exhibited good predictive performance. Then, the parameter settings of MPSO were analyzed, and the MPSO-ANN model was obtained by using MPSO to optimize the weights and biases of the developed ANN model. Finally, the gas-bearing distribution was predicted using multicomponent seismic data. The results indicate that the developed MPSO-ANN model (MSE = 0.0058, RMSE = 0.0762, R-2 = 0.9761) has better predictive performance than the PSO-ANN (MSE = 0.0062, RMSE = 0.0786, R-2 = 0.9713) and unoptimized ANN models (MSE = 0.0069, RMSE = 0.0833, R-2 = 0.9625) on the test dataset. Additionally, the gas-bearing distribution prediction results were consistent overall with the actual drilling results, further verifying the feasibility of this method. The research results may contribute to the application of PSO and ANN in reservoir prediction and other fields.
暂无评论