Efficient parallel computing has become a pivotal element in advancing artificial intelligence. Yet, the deployment of Spiking neuralnetworks (SNNs) in this domain is hampered by their inherent sequential computation...
详细信息
ISBN:
(纸本)9798350359329;9798350359312
Efficient parallel computing has become a pivotal element in advancing artificial intelligence. Yet, the deployment of Spiking neuralnetworks (SNNs) in this domain is hampered by their inherent sequential computational dependency. This constraint arises from the need for each time step's processing to rely on the preceding step's outcomes, significantly impeding the adaptability of SNN models to massively parallel computing environments. Addressing this challenge, our paper introduces the innovative Parallel Spiking Unit (PSU) and its two derivatives, the Input-aware PSU (IPSU) and Reset-aware PSU (RPSU). These variants skillfully decouple the leaky integration and firing mechanisms in spiking neurons while probabilistically managing the reset process. By preserving the fundamental computational attributes of the spiking neuron model, our approach enables the concurrent computation of all membrane potential instances within the SNN, facilitating parallel spike output generation and substantially enhancing computational efficiency. Comprehensive testing across various datasets, including static and sequential images, Dynamic Vision Sensor (DVS) data, and speech datasets, demonstrates that the PSU and its variants not only significantly boost performance and simulation speed but also augment the energy efficiency of SNNs through enhanced sparsity in neural activity. These advancements underscore the potential of our method in revolutionizing SNN deployment for high-performance parallel computing applications.
Cross-modal image-text retrieval has gained increasing attention due to its ability to combine computer vision with natural language processing. Previously, image and text features were extracted and concatenated to f...
详细信息
Cross-modal image-text retrieval has gained increasing attention due to its ability to combine computer vision with natural language processing. Previously, image and text features were extracted and concatenated to feed the transformer-based retrieval network. However, these approaches implicitly aligned the image and text modalities since the self-attention mechanism computes attention coefficients for all input features. In this paper, we propose cross-modal Semantic Alignments Module (SAM) to establish an explicit alignment through enhancing an inter-modal relationship. Firstly, visual and textual representations were extracted from an image and text pair. Secondly, we constructed a bipartite graph by representing the image regions and words in the sentence as nodes, and the relationship between them as edges. Then our proposed SAM allows the model to compute attention coefficients based on the edges in the graph. This process helps explicitly align the two modalities. Finally, a binary classifier was used to determine whether the given image-text pair is aligned. We reported extensive experiments on MS-COCO and Flickr30K test sets, showing that SAM could capture the joint representation between the two modalities and could be applied to the existing retrieval networks.
Spiking neuralnetworks (SNNs) have suitable properties for realizing efficient processing at the edge, while having several similarities to brain-inspired computing that can be applied in neuromorphic computing syste...
详细信息
ISBN:
(纸本)9798350359329;9798350359312
Spiking neuralnetworks (SNNs) have suitable properties for realizing efficient processing at the edge, while having several similarities to brain-inspired computing that can be applied in neuromorphic computing systems. On the other hand, signal processing for wireless communication is an essential application that is critical at the edge. Signal modulation detection is a task that requires reliable accuracy in noisy environments, such as commercial and defense avionics applications. This task can be performed in a neuromorphic system running an SNN classification model using two different technologies: digital or analog. We present a comparative study between a digital manycore-based and an analog memristor-based neuromorphic implementation. We use Intel's LAVA and NeuroPack opensource frameworks to implement them and compare them in terms of accuracy. The results show that the digital technology achieves relevant accuracies, while the analog technology requires a more elaborate portability model to achieve comparable results.
This paper summarizes the video sample collection and processing methods based on artificial intelligence platform, focusing on video noise cancellation, content segmentation and classification, and feature extraction...
详细信息
This paper investigates the application of artificialneuralnetworks optimized based on genetic algorithms in human resource management in hospital enterprises and constructs a human resource management and predictiv...
详细信息
Purpose With the help of basic physics, the application of computer algorithms in the form of recent advances such as machine learning and neural networking in textile Industry has been discussed in this review. Scien...
详细信息
Purpose With the help of basic physics, the application of computer algorithms in the form of recent advances such as machine learning and neural networking in textile Industry has been discussed in this review. Scientists have linked the underlying structural or chemical science of textile materials and discovered several strategies for completing some of the most time-consuming tasks with ease and precision. Since the 1980s, computer algorithms and machine learning have been used to aid the majority of the textile testing process. With the rise in demand for automation, deep learning, and neuralnetworks, these two now handle the majority of testing and quality control operations in the form of imageprocessing. Design/methodology/approach The state-of-the-art of artificial intelligence (AI) applications in the textile sector is reviewed in this paper. Based on several research problems and AI-based methods, the current literature is evaluated. The research issues are categorized into three categories based on the operation processes of the textile industry, including yarn manufacturing, fabric manufacture and coloration. Findings AI-assisted automation has improved not only machine efficiency but also overall industry operations. AI's fundamental concepts have been examined for real-world challenges. Several scientists conducted the majority of the case studies, and they confirmed that image analysis, backpropagation and neural networking may be specifically used as testing techniques in textile material testing. AI can be used to automate processes in various circumstances. Originality/value This research conducts a thorough analysis of artificialneural network applications in the textile sector.
neural Architecture Search (NAS) aims to automate the design process of Deep neuralnetworks (DNN) without requiring profound domain knowledge. The Deep Genetic Algorithm (DeepGA) was proposed to find the architecture...
详细信息
Emerging optoelectronic synapses hold immense potential for advancing neuromorphic computing systems. However, achieving precise control over selective responses in optoelectronic memory and clarifying tunable synapti...
详细信息
Emerging optoelectronic synapses hold immense potential for advancing neuromorphic computing systems. However, achieving precise control over selective responses in optoelectronic memory and clarifying tunable synaptic weights has remained challenging. This study reports an optoelectronic synapse utilizing oxygen plasma-assisted defect engineering in tellurene for artificialneuralnetworks. Through DFT calculations and experimental analyses, we demonstrate that tellurene conductance can be modulated by controlling plasma-defined defect engineering, allowing a transition from short-term to long-term synaptic plasticity, largely determined by intrinsic large-lattice-relaxation effects. Our artificial synapses exhibit high linearity, a broad dynamic range, and tunable synaptic weights. Additionally, our optoelectronic synapses display selective sensitivity to multi-spectral light and achieve a pattern recognition accuracy of up to 96.7% across five typical datasets, surpassing even the ideal synapse. These tunable spectral responses, combined with high-performance neuromorphic applications using spike coding, establish a foundation for developments in brain-inspired machine learning, robotics, and real-time data processing.
Deep neuralnetworks (DNNs) have achieved impressive results in image classification tasks. Recent studies have shown that adding imperceptible perturbations to original images can cause image recognition models to ma...
详细信息
Deep neuralnetworks (DNNs) have achieved impressive results in image classification tasks. Recent studies have shown that adding imperceptible perturbations to original images can cause image recognition models to make erroneous judgments. Additionally, visible marks, which add text or image information to images, serve as a reminder of copyright ownership and can help preventing image theft and infringement. In a sense, visible text mark can be seen as meaningful noise added to clean images. In this article, we propose a method (GAM) that combines text mark and adversarial examples by focusing perturbations on meaningful text that does not affect human judgment, while causing image classification models to produce incorrect results.
The DNCS (Cascaded CNN-ANN) enabled Food Recognition (FR) and Associated Calorie Level Estimation System presents a novel approach to food classification and calorie estimation using a cascaded neural network architec...
详细信息
暂无评论