Graph neuralnetworks lose a lot of their computing power when more network layers are added. As a result, the majority of existing graph neuralnetworks have a shallow depth of learning. Over-smoothing and informatio...
详细信息
Graph neuralnetworks lose a lot of their computing power when more network layers are added. As a result, the majority of existing graph neuralnetworks have a shallow depth of learning. Over-smoothing and information loss are two of the key issues that restrict graph neuralnetworks from going deeper. As network depth goes up, the embeddings of all the nodes eventually converge on the same value, which separates output representations from input vectors and causes over-smoothing. Moreover, layers of graph pooling are required in a deep learning model to retrieve specified features for prediction, which results in some degree of information loss. In this research, we present a new and multi-scale approach for overcoming these constraints by using concepts from graph theory, namely learnable edge sampling and line graphs. An edge-sampling mechanism that selects a particular number of edges through a learning parameter before training reduces oversmoothing, and the issue of information loss is alleviated using a line graph technique that converts the original graph into a similar line graph. Our method of edge sampling preserves the core spectral features of the graph without affecting its fundamental structure. Our suggested technique outperforms state-of-the-art models on publicly available datasets of diverse applications while having minimal constraints and great training skills.
The trend of integrating different distributed generation sources into the existing grid have increased the probability of power quality disturbances to a threatening level. Eventually, detection, protection and mitig...
详细信息
The trend of integrating different distributed generation sources into the existing grid have increased the probability of power quality disturbances to a threatening level. Eventually, detection, protection and mitigation of these disturbances are even more challenging. In this regard, the article presents an intelligent power quality disturbance classification scheme using a 2D convolutional neuralnetwork designed from a systematic and structural standpoint. A total of 8 singular, 5 complex power quality events are simulated and voltage data collection is made from a test system designed in MATLAB Simulink environment. The three-phase voltage data is converted to a single signal arrangement through a newly proposed Unique Clark's Transformed Sequence. In addition to that, the scheme completely eliminates the worry of a signal processing stage by proposing a novel scaled matrix image created out of 2-cycle data collected at 6.4kHz sampling frequency that acts as input to the CNN architecture designed in the PYTHON environment. Further, the novelty extended to design a pseudo-real-time setup where the MATLAB environment continuously runs the test system, producing scaled matrix images. These images are saved to a shared directory, enabling a PYTHON loop for prompt event classification through the trained CNN model. The model performance is found to be 100% under ideal conditions. It has also tested under three different noise conditions of 40dB, 30dB and 20dB and obtained an overall accuracy of 98.86% with singular events. Further, the method is also verified for complex and unsymmetrical dataset and found to be equally effective. Additionally, the validation is likewise made with a trivial set of real-time simulated data using OPAL-RT 4510 setup. Finally, the proposed PQ detection scheme is compared with recently published work to express its superiority over other similar studies in terms of classification *** TERMS Convolutional neuralnetwork, deep l
The second-order optimization methods, notably the D-KFAC (distributed Kronecker Factored Approximate Curvature) algorithms, have gained traction on accelerating deep neuralnetwork (DNN) training on GPU clusters. How...
详细信息
The second-order optimization methods, notably the D-KFAC (distributed Kronecker Factored Approximate Curvature) algorithms, have gained traction on accelerating deep neuralnetwork (DNN) training on GPU clusters. However, existing D-KFAC algorithms require to compute and communicate a large volume of second-order information, i.e., Kronecker factors (KFs), before preconditioning gradients, resulting in large computation and communication overheads as well as a high memory footprint. In this article, we propose DP-KFAC, a novel distributed preconditioning scheme that distributes the KF constructing tasks at different DNN layers to different workers. DP-KFAC not only retains the convergence property of the existing D-KFAC algorithms but also enables three benefits: reduced computation overhead in constructing KFs, no communication of KFs, and low memory footprint. Extensive experiments on a 64-GPU cluster show that DP-KFAC reduces the computation overhead by 1.55x-1.65x, the communication cost by 2.79x-3.15x, and the memory footprint by 1.14x-1.47x in each second-order update compared to the state-of-the-art D-KFAC methods.
This paper considers the distributed learning problem where a group of agents cooperatively minimizes the summation of their local cost functions based on peer-to-peer communication. Particularly, we propose a highly ...
distributed acoustic sensors(DASs) can effectively monitor acoustic fields along sensing fibers with high sensitivity and high response speed. However, their data processing is limited by the performance of electron...
distributed acoustic sensors(DASs) can effectively monitor acoustic fields along sensing fibers with high sensitivity and high response speed. However, their data processing is limited by the performance of electronic signal processing, hindering real-time applications. The time-wavelength multiplexed photonic neuralnetwork accelerator(TWM-PNNA), which uses photons instead of electrons for operations, significantly enhances processing speed and energy efficiency. Therefore, we explore the feasibility of applying TWMPNNA to DAS systems. We first discuss processing large DAS system data for compatibility with the TWM-PNNA system. We also investigate the effects of chirp on optical convolution in complex tasks and methods to mitigate its impact on classification accuracy. Furthermore, we propose a method for achieving an optical full connection and study the influence of pruning on the full connection to reduce the computational burden of the model. Experimental results indicate that decreasing the ratio of Δλchirp∕Δλ or choosing push–pull modulation can eliminate the impact of chirp on recognition accuracy. In addition, when the full connection parameter retention rate is no less than 60%, it can still maintain a classification accuracy of over 90%.TWM-PNNA provides an innovative computational framework for DAS systems, paving the way for the all-optical fusion of DAS systems with computational systems.
Fully Connected neuralnetwork (FCNN) are widely used in image recognition and natural language processing. However, the time cost of training large datasets is high. Optical network-on Chip (ONoC) has been proposed t...
详细信息
The current financial sharing platform has no advantages when dealing with nonlinear relationships. The purpose of this research is to apply neuralnetwork algorithms to build an intelligent financial sharing platform...
详细信息
Our research introduces a framework that integrates edge computing, quantum transfer learning, and federated learning to revolutionize pain level assessment through ECG signal analysis. The primary focus lies in devel...
详细信息
Our research introduces a framework that integrates edge computing, quantum transfer learning, and federated learning to revolutionize pain level assessment through ECG signal analysis. The primary focus lies in developing a robust, privacy-preserving system that accurately classifies pain levels (low, medium, and high) by leveraging the intricate relationship between pain perception and autonomic nervous system responses captured in ECG signals. At the heart of our methodology lies a signal processing approach that transforms one-dimensional ECG signals into rich, two-dimensional Continuous Wavelet Transform (CWT) images. These transformations capture both temporal and frequency characteristics of pain-induced cardiac variations, providing a comprehensive representation of autonomic nervous system responses to different pain intensities. Our framework processes these CWT images through a sophisticated quantum-classical hybrid architecture, where edge devices perform initial preprocessing and feature extraction while maintaining data privacy. The cornerstone of our system is a Quantum Convolutional Hybrid neuralnetwork (QCHNN) that harnesses quantum entanglement properties to enhance feature detection and classification robustness. This quantum-enhanced approach is seamlessly integrated into a federated learning framework, allowing distributed training across multiple healthcare facilities while preserving patient privacy through secure aggregation protocols. The QCHNN demonstrated remarkable performance, achieving a classification accuracy of 94.8% in pain level assessment, significantly outperforming traditional machine learning approaches.
Manual annotation of audio material is cumbersome. Active learning aims at minimizing the annotation effort by iteratively selecting an acquisition batch of unlabeled data, asking a human to annotate the selected data...
详细信息
ISBN:
(纸本)9798350344868;9798350344851
Manual annotation of audio material is cumbersome. Active learning aims at minimizing the annotation effort by iteratively selecting an acquisition batch of unlabeled data, asking a human to annotate the selected data and re-training a classifier until an annotation budget is depleted. In this paper we propose the Gaussian-dense active learning (GDAL) algorithm to train a sound event classifier. The classifier is a Bayesian neuralnetwork where the weights are normally distributed. This is in contrast to conventional neuralnetworks where weights are not distributed, but have assigned values. The Bayesian nature of the classifier empowers GDAL to select acquisition batches from a set of unlabeled audio clips based on their estimated informativeness. Evaluation results on the UrbanSound8k dataset show that GDAL outperforms a state-of-the-art algorithm based on medoid active learning for all considered annotation budgets and an algorithm based on dropout active learning for sufficiently large annotation budgets.
Accurate detection of end-diastole (ED) and end-systole (ES) frames is a crucial step in cardiac function analysis, enabling precise measurement of ventricular volume, ejection fraction (EF), and stroke volume (SV). H...
详细信息
Accurate detection of end-diastole (ED) and end-systole (ES) frames is a crucial step in cardiac function analysis, enabling precise measurement of ventricular volume, ejection fraction (EF), and stroke volume (SV). However, this task is challenging due to variations in cardiac structure, heart rate fluctuations associated with clinical conditions, and the low-resolution nature of echocardiographic sequences. This study addresses these challenges by introducing three preprocessing steps - noise reduction via heart rate formulation, video frame synchronization, and non-oscillating mean absolute frame difference - to denoise and enhance the EchoNetDynamic dataset. Additionally, the echo phase detection problem is reformulated as a frame-level binary classification task to mitigate class imbalance between diastole and systole phases. The proposed architecture employs a time-distributed convolutional neuralnetwork (CNN) to extract spatial features, followed by a bidirectional long short-term memory (BiLSTM) network to capture temporal dynamics, and a classification layer for phase prediction. The model achieves an average absolute frame distance of 1.02 and 1.04 frames for ED and ES frames, respectively, on the preprocessed EchoNet-Dynamic dataset. To ensure better generalization, the model was also validated on the CAMUS dataset and private data, where it demonstrated consistent performance and robust results. These findings significantly enhance the reliability of cardiac metrics, offering clinicians a precise and efficient tool for echocardiographic analysis.
暂无评论