Neuromorphic computing using photonic hardware is a promising route towards ultrafast processing while maintaining low power consumption. Here we present and numerically evaluate a hardware concept for realizing photo...
详细信息
Spiking neuralnetworks (SNNs) are bio-plausible models that hold great potential for realizing energy-efficient implementations of sequential tasks on resource-constrained edge devices. However, commercial edge platf...
详细信息
Spiking neuralnetworks (SNNs) are bio-plausible models that hold great potential for realizing energy-efficient implementations of sequential tasks on resource-constrained edge devices. However, commercial edge platforms based on standard GPUs are not optimized to deploy SNNs, resulting in high energy and latency. While analog In-Memory computing (IMC) platforms can serve as energy-efficient inference engines, they are accursed by the immense energy, latency, and area requirements of high-precision ADCs (HP-ADC), overshadowing the benefits of in-memory computations. We propose a hardware/software co-design methodology to deploy SNNs into an ADC-Less IMC architecture using sense-amplifiers as 1-bit ADCs replacing conventional HP-ADCs and alleviating the above issues. Our proposed framework incurs minimal accuracy degradation by performing hardware-aware training and is able to scale beyond simple image classification tasks to more complex sequential regression tasks. Experiments on complex tasks of optical flow estimation and gesture recognition show that progressively increasing the hardware awareness during SNN training allows the model to adapt and learn the errors due to the non-idealities associated with ADC-Less IMC. Also, the proposed ADC-Less IMC offers significant energy and latency improvements, 2-7 and8.9-24.6 chi, respectively, depending on the SNN model and the workload, compared to HP-ADC IMC.
作者:
Miri, Mohammad-AliMenon, VinodCUNY
Queens Coll Dept Phys Queens NY 11367 USA CUNY
Grad Ctr Phys Program New York NY 10016 USA CUNY
City Coll Dept Phys New York NY 10031 USA
We show that coherent laser networks (CLNs) exhibit emergent neuralcomputing capabilities. The proposed scheme is built on harnessing the collective behavior of laser networks for storing a number of phase patterns a...
详细信息
We show that coherent laser networks (CLNs) exhibit emergent neuralcomputing capabilities. The proposed scheme is built on harnessing the collective behavior of laser networks for storing a number of phase patterns as stable fixed points of the governing dynamical equations and retrieving such patterns through proper excitation conditions, thus exhibiting an associative memory property. It is discussed that despite the large storage capacity of the network, the large overlap between fixed-point patterns effectively limits pattern retrieval to only two images. Next, we show that this restriction can be uplifted by using nonreciprocal coupling between lasers and this allows for utilizing a large storage capacity. This work opens new possibilities for neural computation with coherent laser networks as novel analog processors. In addition, the underlying dynamical model discussed here suggests a novel energy-based recurrent neural network that handles continuous data as opposed to Hopfield networks and Boltzmann machines that are intrinsically binary systems.
As a promising alternative to traditional CMOS circuits, optics has demonstrated the ability to realize ultra-high speed and low-power information processing and communications. For opticalcomputing tasks including B...
As a promising alternative to traditional CMOS circuits, optics has demonstrated the ability to realize ultra-high speed and low-power information processing and communications. For opticalcomputing tasks including Boolean logic and neuralnetworks, however, there still exist challenges such as optical power efficiency, bulkiness and noise-robustness. To address the aforementioned issues, this dissertation proposes a set of algorithms, methodology, and architectures for opticalcomputing tasks, which include: a synthesis flow that significantly reduces the optical power loss; a set of synthesis algorithms that exploits wavelength-division multiplexing (WDM) for area-efficient optical logic construction; a hardware-software codesign methodology that generates more area-efficient and robust ONNs; and an on-chip, integratable photonic Elman RNN architecture that empowers photonic RNNs the capability of training and tuning the state transformation for the first time. For the first work, we study the long-neglected optical power depletion problem in previous optical boolean logic synthesis, and propose graph transform techniques along with the exploitation of better optical devices to address this problem. The experiments where various sources of optical power depletion are considered, show the efficacy of our method of generating optical power efficient optical circuits, which also helps to build a much more robust and scalable integrated photonic system. In the second work, we exploit a special property of light in optical logic synthesis to reduce the number of optical components. The great potential of adopting WDM for efficient optical logic construction, is pinpointed and a systematic synthesis flow is designed considering the practical capacity constraint. Mathematically, we demonstrate the affinity of the capacity-constrained synthesis problem to the hypergraph partitioning and the min-cost max-flow problem. The experiments show the efficiency and efficacy of ou
RRAM-based crossbars and opticalneuralnetworks are attractive platforms to accelerate neuromorphic computing. However, both accelerators suffer from hardware uncertainties such as process variations. These uncertain...
详细信息
ISBN:
(数字)9781450379991
ISBN:
(纸本)9781728180571
RRAM-based crossbars and opticalneuralnetworks are attractive platforms to accelerate neuromorphic computing. However, both accelerators suffer from hardware uncertainties such as process variations. These uncertainty issues left unaddressed, the inference accuracy of these computing platforms can degrade significantly. In this paper, a statistical training method where weights under process variations and noise are modeled as statistical random variables is presented. To incorporate these statistical weights into training, the computations in neuralnetworks are modified accordingly. For opticalneuralnetworks, we modify the cost function during software training to reduce the effects of process variations and thermal imbalance. In addition, the residual effects of process variations are extracted and calibrated in hardware test, and thermal variations on devices are also compensated in advance. Simulation results demonstrate that the inference accuracy can be improved significantly under hardware uncertainties for both platforms.
Photonic neuralnetworks (PNNs) based on silicon photonic integrated circuits (Si-PICs) offer significant advantages over microelectronic counterparts, including lower energy consumption, higher bandwidth, and faster ...
详细信息
Photonic neuralnetworks (PNNs) based on silicon photonic integrated circuits (Si-PICs) offer significant advantages over microelectronic counterparts, including lower energy consumption, higher bandwidth, and faster computing speeds. However, the analog nature of optical signal in PNNs makes Si-PIC solutions highly sensitive to device noise, especially when using fixed-value deterministic models, which are not robust to hardware fluctuation. Furthermore, current PNNs are unable to handle data uncertainty, a critical factor in applications such as autonomous driving, medical diagnostics, and financial forecasting. Herein, a photonic Bayesian neural network (PBNN) architecture that incorporates Bayesian principles to enhance robustness and address uncertainty is proposed. In the PBNN, device noise is leveraged through photonic-noise-based random number generators, which combine Mach-Zehnder interferometers and micro-ring resonators to independently control output mean and standard deviation. Based on modelling with experimentally extracted data, the PBNN achieves a classification accuracy of up to 98% for handwritten digit recognition, matching full-precision models on conventional computers. Beyond classification, the PBNN excels in multimodal data processing, regression, and outlier detection. This scalable, energy-efficient architecture transforms photonic noise into computational value, addressing the limitations of deterministic PNNs and enabling uncertainty-aware computing for real-world applications.
This study introduces physical reservoir computing (PRC) using in vitro biological neuralnetworks for efficient signal processing and *** system employs optogenetic control and First-Order Reduced and Controlled Erro...
详细信息
Brain-inspired computing, drawing inspiration from the fundamental structure and information-processing mechanisms of the human brain, has gained significant momentum in recent years. It has emerged as a research para...
详细信息
Brain-inspired computing, drawing inspiration from the fundamental structure and information-processing mechanisms of the human brain, has gained significant momentum in recent years. It has emerged as a research paradigm centered on brain–computer dual-driven and multi-network integration. One noteworthy instance of this paradigm is the hybrid neural network(HNN), which integrates computer-science-oriented artificial neuralnetworks(ANNs) with neuroscience-oriented spiking neuralnetworks(SNNs). HNNs exhibit distinct advantages in various intelligent tasks, including perception, cognition and learning. This paper presents a comprehensive review of HNNs with an emphasis on their origin, concepts, biological perspective, construction framework and supporting systems. Furthermore, insights and suggestions for potential research directions are provided aiming to propel the advancement of the HNN paradigm.
Artificial intelligence has prevailed in all trades and professions due to the assistance of big data resources,advanced algorithms,and high-performance electronic ***,conventional computing hardware is inefficient at...
详细信息
Artificial intelligence has prevailed in all trades and professions due to the assistance of big data resources,advanced algorithms,and high-performance electronic ***,conventional computing hardware is inefficient at implementing complex tasks,in large part because the memory and processor in its computing architecture are separated,performing insufficiently in computing speed and energy *** recent years,opticalneuralnetworks(ONNs)have made a range of research progress in opticalcomputing due to advantages such as subnanosecond latency,low heat dissipation,and high *** are in prospect to provide support regarding computing speed and energy consumption for the further development of artificial intelligence with a novel computing ***,we first introduce the design method and principle of ONNs based on various optical ***,we successively review the non-integrated ONNs consisting of volume optical components and the integrated ONNs composed of on-chip ***,we summarize and discuss the computational density,nonlinearity,scalability,and practical applications of ONNs,and comment on the challenges and perspectives of the ONNs in the future development trends.
暂无评论