Spiking neuralnetworks (SNN) hold the promise of being a more biologically plausible, low-energy alternative to conventional artificialneuralnetworks. Their time-variant nature makes them particularly suitable for ...
详细信息
ISBN:
(纸本)9798350390599;9798350390582
Spiking neuralnetworks (SNN) hold the promise of being a more biologically plausible, low-energy alternative to conventional artificialneuralnetworks. Their time-variant nature makes them particularly suitable for processing time-resolved, sparse binary data. In this paper, we investigate the potential of leveraging SNNs for the detection of photon coincidences in positron emission tomography (PET) data. PET is a medical imaging technique based on injecting a patient with a radioactive tracer and detecting the emitted photons. One central post-processing task for inferring an image of the tracer distribution is the filtering of invalid hits occurring due to e.g. absorption or scattering processes. Our approach, coined PETNet, interprets the detector hits as a binary-valued spike train and learns to identify photon coincidence pairs in a supervised manner. We introduce a dedicated multi-objective loss function and demonstrate the effects of explicitly modeling the detector geometry on simulation data for two use-cases. Our results show that PETNet can outperform the state-of-the-art classical algorithm with a maximal coincidence detection F1 of 95.2%. At the same time, PETNet is able to predict photon coincidences up to 36 times faster than the classical approach, highlighting the great potential of SNNs in particle physics applications.
In recent years, convolutional neuralnetworks have shown significant success and are frequently used in medical image analysis applications. However, the convolution process in convolutional neuralnetworks limits le...
详细信息
ISBN:
(纸本)9798350343557
In recent years, convolutional neuralnetworks have shown significant success and are frequently used in medical image analysis applications. However, the convolution process in convolutional neuralnetworks limits learning of long-term pixel dependencies in the local receptive field. Inspired by the success of transformer architectures in encoding long-term dependencies and learning more efficient feature representation in natural language processing, publicly available color fundus retina, skin lesion, chest X-ray, and breast histology images are classified using Vision Transformer (ViT), Data-Efficient Transformer (DeiT), Swin Transformer, and Pyramid Vision Transformer v2 (PVTv2) models and their classification performances are compared in this study. The results show that the highest accuracy values are obtained with the DeiT model at 96.5% in the chest X-ray dataset, the PVTv2 model at 91.6% in the breast histology dataset, the PVTv2 model at 91.3% in the retina fundus dataset, and the Swin model at 91.0% in the skin lesion dataset.
Spiking neuralnetworks (SNNs) are rich in spatio-temporal dynamics and are suitable for processing event-based neuromorphic data. However, event-based datasets are usually less annotated than static datasets. This sm...
详细信息
ISBN:
(纸本)9781577358879
Spiking neuralnetworks (SNNs) are rich in spatio-temporal dynamics and are suitable for processing event-based neuromorphic data. However, event-based datasets are usually less annotated than static datasets. This small data scale makes SNNs prone to overfitting and limits their performance. In order to improve the generalization ability of SNNs on event-based datasets, we use static images to assist SNN training on event data. In this paper, we first discuss the domain mismatch problem encountered when directly transferring networks trained on static datasets to event data. We argue that the inconsistency of feature distributions becomes a major factor hindering the effective transfer of knowledge from static images to event data. To address this problem, we propose solutions in terms of two aspects: feature distribution and training strategy. Firstly, we propose a knowledge transfer loss, which consists of domain alignment loss and spatio-temporal regularization. The domain alignment loss learns domain-invariant spatial features by reducing the marginal distribution distance between the static image and the event data. Spatio-temporal regularization provides dynamically learnable coefficients for domain alignment loss by using the output features of the event data at each time step as a regularization term. In addition, we propose a sliding training strategy, which gradually replaces static image inputs probabilistically with event data, resulting in a smoother and more stable training for the network. We validate our method on neuromorphic datasets, including N-Caltech101, CEP-DVS, and N-Omniglot. The experimental results show that our proposed method achieves better performance on all datasets compared to the current state-of-the-art methods. Code is available at https://***/Brain-Cog-Lab/Transfer-for-DVS.
Computed tomography (CT) technology is widely used, but the X-ray radiation it emits is a concern. As a result, more and more research is focusing on how to maintain the quality of CT images while reducing the X-ray d...
详细信息
The widespread use of deep learning has achieved unprecedented success. neuralnetworks have achieved remarkable results in natural language processing, image recognition and other application fields. The key to the s...
详细信息
The widespread use of deep learning has achieved unprecedented success. neuralnetworks have achieved remarkable results in natural language processing, image recognition and other application fields. The key to the success of neuralnetworks lies in its efficient processing of Euclidean space data, but the results obtained when traditional neuralnetworks are used in non-Euclidean spaces are often not satisfactory to researchers. Graph neural network has been widely developed as a neural network that can be used in non-Euclidean space. This paper starts with the basic knowledge of graphs, introduces graph neuralnetworks, and makes a new classification of them. Then it illustrates its application from 18 application areas. Finally, I put forward my own views on the future development and challenges of graph neuralnetworks.
Numerous studies have indicated the potential involvement of seismic-ionospheric precursors (SIPs) in catastrophic earthquakes. These SIPs have been extensively analyzed in terms of characteristics such as the degree ...
详细信息
ISBN:
(纸本)9798350367331;9798350367348
Numerous studies have indicated the potential involvement of seismic-ionospheric precursors (SIPs) in catastrophic earthquakes. These SIPs have been extensively analyzed in terms of characteristics such as the degree of decrease or increase, timing of occurrence, and duration, with a specific focus on electron density or total electron content (TEC). While deep neuralnetworks have demonstrated remarkable accuracy in various applications, their capability to estimate SIPs has been severely limited. In this study, we developed a novel AI prediction model for forecasting SIPs based on a six-channel data sequence: TEC, median TEC, lower bound TEC, upper bound TEC, positive polarity, and negative polarity. To leverage the power of deep learning image classification methods, we treated this data as a six-dimensional image. This approach yielded a maximum accuracy of 67.1 percent.
Various daily applications, including image categorization, natural language comprehension, and voice identification, heavily rely on fully connected and convolutional neuralnetworks. When tackling classification pro...
详细信息
Deep neural network based military vehicle detectors pose particular challenges due to the scarcity of relevant images and limited access to vehicles in this domain, particularly in the infrared spectrum. To address t...
详细信息
ISBN:
(纸本)9781510673892;9781510673885
Deep neural network based military vehicle detectors pose particular challenges due to the scarcity of relevant images and limited access to vehicles in this domain, particularly in the infrared spectrum. To address these issues, a novel drone-based bi-modal vehicle acquisition method is proposed, capturing 72 key images from different view angles of a vehicle in a fast and automated way. By overlaying vehicle patches with relevant background images and utilizing data augmentation techniques, synthetic training images are obtained. This study introduces the use of AI-generated synthetic background images compared to real video footage. Several models were trained and their performance compared in real-world situations. Results demonstrate that the combination of data augmentation, context-specific background samples, and synthetic background images significantly improves model precision while maintaining Mean Average Precision, highlighting the potential of utilizing Generative AI (Stable Diffusion) and drones to generate training datasets for object detectors in challenging domains.
Deep learning techniques have significantly impacted fields such as imageprocessing, computer vision, and natural language processing. However, their influence on quantitative finance, particularly in option pricing,...
详细信息
ISBN:
(纸本)9798400710810
Deep learning techniques have significantly impacted fields such as imageprocessing, computer vision, and natural language processing. However, their influence on quantitative finance, particularly in option pricing, hedging, and portfolio management, has been limited. Traditional financial applications rely on rigorous mathematical models and established numerical methods like Monte Carlo and finite difference methods. However, these methods struggle with high-dimensional problems. Recent works propose using Deep neuralnetworks (DNNs) to solve high-dimensional Partial Differential Equations (PDEs) in finance, potentially overcoming the limitations of conventional techniques. Despite the recent progress, DNN methods face high computational costs, stability issues, and generally fail to meet the high accuracy requirements of the financial industry. This paper addresses these challenges. To address the high computational cost of training deep neuralnetworks for financial applications, we propose a multilevel architecture inspired by multilevel Monte Carlo methods. To enhance stability, we adopt a dynamical systems perspective and utilize the NAIS-Net architecture, which ensures global asymptotic stability. For improving accuracy, we leverage the forward and backward systems of stochastic differential equations (FBSDEs) for option pricing problems. We also provide a theoretical argument that suggests that the proposed approach is superior to Physics Informed neuralnetworks. Finally, the proposed methodology is implemented on several option pricing and xVA problems and is shown to achieve higher efficiency and accuracy, notably improving the pricing of options and xVAs by an order of magnitude over state-of-the-art methods.
Liquid crystal image classification is a vital part of modern biosensors. Recent studies have shown that this problem can be solved using computationally intensive intelligent analysis tools, such as convolutional neu...
详细信息
Liquid crystal image classification is a vital part of modern biosensors. Recent studies have shown that this problem can be solved using computationally intensive intelligent analysis tools, such as convolutional neuralnetworks (CNNs) and support vector machines (SVMs). This article proposes a new method of microscopic image classification for liquid crystals-based biosensors with fast response. This method is based on topological analysis and provides 95% accuracy. Moreover, on the same hardware, it reaches eightfold performance compared to CNNs, which are usually used in similar applications. Finally, it has only nine parameters. Most of those parameters are independent and can be easily tuned based on the properties of the liquid crystals suspension and the microscope. This is a significant benefit compared to machine learning approaches that require large training datasets. The proposed solution can be considered a new step toward the creation of fully automatic biosensors for industrial water quality assessment systems.
暂无评论