Understanding and predicting microelectronic failures is important for ensuring the reliability of modern electronic devices. In this paper, we develop a set of computer vision algorithms for modeling device failure d...
详细信息
Understanding and predicting microelectronic failures is important for ensuring the reliability of modern electronic devices. In this paper, we develop a set of computer vision algorithms for modeling device failure due to electromigration, in which metal atoms are displaced due to current flow. The experimental setup contains a series of optical and thermal images of aluminum interconnects. We propose deep neuralnetworks for two specific problems: predicting where in the device a failure will occur, and estimating the remaining lifespan before failure. We pose the former as a segmentation problem and solve it with a convolutional neuralnetwork (CNN) trained on multi-scale optical images. We pose the latter as a regression problem for which we designed a convolutional neuralnetwork augmented with a recurrent module (RNN) to model the temporal dimension. We compare against two baseline networks, finding that our model can predict the age of the aluminum more accurately from the optical images instead of the thermal ones. This work is the first that pursues a deep neuralnetwork-based modeling to predict electromigration failures from experimental optical and thermal images.
The retina is an essential part of the eye and works to transmit visual information to the brain. In maintaining the eye, an ophthalmologist needs regular examinations, but the price is expensive and takes time. There...
详细信息
ISBN:
(纸本)9781665401524
The retina is an essential part of the eye and works to transmit visual information to the brain. In maintaining the eye, an ophthalmologist needs regular examinations, but the price is expensive and takes time. Therefore, technological developments are expected to help the medical world to detect diseases. The technology is image processing. Convolutional neuralnetwork (CNN) is the most popular neuralnetwork model to handle image analysis and can recognize patterns from an image accurately. This study detected Drusens, Optic Disc Cupping, and Tessellation diseases using 534 fundus images. The architecture used Convolutional neuralnetwork-based Support Vector Machine (CNN based SVM) and DenseNet, which is a Convolutional neuralnetwork architecture development. In obtaining the best results, in this study, we use several variations of the optimizer, namely adam, nadam, and RMSprop, and the best results from this study can be seen from the accuracy value of 93,21% using the DenseNet architecture.
Recent investigations in neuromorphic photonics exploit optical device physics for neuron models, and optical interconnects for distributed, parallel, and analog processing. Integrated solutions enabled by silicon pho...
详细信息
Recent investigations in neuromorphic photonics exploit optical device physics for neuron models, and optical interconnects for distributed, parallel, and analog processing. Integrated solutions enabled by silicon photonics enable high-bandwidth, low-latency and low switching energy, making it a promising candidate for special-purpose artificial intelligence hardware accelerators. Here, we experimentally demonstrate a silicon photonic chip that can perform training and testing of a Hopfield network, i.e. recurrent neuralnetwork, via vector dot products. We demonstrate that after online training, our trained Hopfield network can successfully reconstruct corrupted input patterns.
近年来,随着深度学习的发展,深度神经网络(Deep neuralnetwork,DNN)模型变得越来越复杂,所需的内存和数据传输量也随之增大,这不仅降低了DNN的训练和推理速度,也限制了DNN在一些内存较小、计算能力较差的物联网(Internet of Things,IoT...
详细信息
近年来,随着深度学习的发展,深度神经网络(Deep neuralnetwork,DNN)模型变得越来越复杂,所需的内存和数据传输量也随之增大,这不仅降低了DNN的训练和推理速度,也限制了DNN在一些内存较小、计算能力较差的物联网(Internet of Things,IoT)设备上的部署。现有研究将基于云–边–端协同的分布式计算框架与深度神经网络相结合,组成了分布式深度神经网络(Distributed Deep neuralnetwork,DDNN)框架,该框架在IoT应用场景下有着显著的优势。然而,DDNN框架存在设备的计算能力有限、以及设备之间的传输成本较高等问题。针对上述问题,本文提出了自适应的分布式深度神经网络(Adaptive Distributed Deep neuralnetwork,ADA-DDNN)推理框架。ADA-DDNN框架采用了多个边缘出口,这些边缘出口允许ADA-DDNN框架中的模型在不同的深度层次上进行自适应地推理,以适应不同的任务需求和数据特性。此外,该框架增加了额外的边缘处理模块,边缘处理模块可以在边缘端进行特征融合之前,判断每个终端模块的输出结果是否可信,若可信,则直接输出分类结果,无需进行特征融合和后续计算。这大大增加了样本的边缘出口概率,减少了后续的计算成本。本文在开放的CIFAR-10数据集上进行验证,实验结果表明,ADD-DDNN框架在保证云端测试精度的前提下,显著提升了边缘测试精度。
This paper proposes a method to generate a sonar image from an optical image, called optic-to-sonar which is one direction of opti-acoustic translation. To convert an optical image into a sonar image having a differen...
详细信息
ISBN:
(纸本)9781665427883
This paper proposes a method to generate a sonar image from an optical image, called optic-to-sonar which is one direction of opti-acoustic translation. To convert an optical image into a sonar image having a different geometry, the proposed method first reconstructs a three-dimensional point cloud by estimating the depth information using a neuralnetwork from given optical images. Then the sonar image is generated through the sonar projection model. We verified the proposed method through water tank experiments. The proposed method can generate a sonar image of the same viewpoint as a given optical image. So, it can be utilized as a dataset augmentation technique to further develop opti-acoustics in an underwater environment where data acquisition is challenging.
We propose a spatial calibration method for wide Field-of-View (FoV) Near-Eye Displays (NEDs) with complex image distortions. Image distortions in NEDs can destroy the reality of the virtual object and cause sickness....
详细信息
AI's exponentially growing computational demands conflict with slow hardware advances. The high-power consumption and long training times of large-scale models call for alternative solutions. opticalcomputing-bas...
详细信息
AI's exponentially growing computational demands conflict with slow hardware advances. The high-power consumption and long training times of large-scale models call for alternative solutions. opticalcomputing-based traditional opticalnetworks and diffractive deep neuralnetwork (D2NN) still face deployment challenges and reliance on electronic networks. To address these issues, we replace the free-space interlayer propagation in conventional opticalnetworks with fiber-based propagation. This preserves the advantages of traditional opticalnetworks while providing additional benefits such as ease of deployment, reduced dependence on electronic networks, and enhanced robustness. Experimental results demonstrate that this untrained structure exhibits strong nonlinear mapping capabilities across different configurations, yielding distinct outputs for three input targets, especially at 1550 nm. Furthermore, the influence of environment and noise is around 1% in target recognition. Leveraging inherent spectral discrimination, this architecture enables multidimensional target identification with important implications for complex target classification and multidimensional sensing.
Low-resolution infrared (IR) array sensors offer a low-cost, low-power, and privacy-preserving alternative to optical cameras and smartphones/wearables for social distance monitoring in indoor spaces, permitting the r...
详细信息
The manufacturing of integrated circuits (ICs) has been continuously improved through the advancement of fabrication technology nodes. However the lithography hotspots (HSs) caused by optical diffraction problems seri...
详细信息
ISBN:
(纸本)9783981926354
The manufacturing of integrated circuits (ICs) has been continuously improved through the advancement of fabrication technology nodes. However the lithography hotspots (HSs) caused by optical diffraction problems seriously affect the yield and reliability of ICs. Although lithography simulation can accurately capture the HSs through physically simulating the lithography process, it requires a lot of computing resources, which usually takes > 100 CPU .h/mm(2) [1]. Due to the image recognition nature, the state-of-the-art HS identification algorithms based on deep learning have obvious advantages in reducing run time comparing to the traditional algorithms. However, its accuracy still needs to be enhanced since there are many false alarms of non-hotspots (NHSs) and escapes of the real HSs, which makes it difficult to be a signoff technique. In this paper, we propose two enhancements in HS identification. First, a hybrid deep learning model is proposed in lithography HS identification, which includes a CNN model to combine physical features. Second, an ensemble learning method is proposed based on multiple sub-models. The proposed enhanced model and method can achieve high HS identification accuracy on the benchmarks 1-4 of the ICCAD 2012 dataset with recall> 98.8%. In addition, it can achieve even 100% recall on the benchmark 1 and benchmark 3 while maintaining the precision at a high level with 53.6% and 87.1%, respectively. Moreover, for the first time it can achieve not only 100% recall on benchmark 5, but also high precision of 61.8%, which is much higher than any published deep learning methods for HSs identification, as far as we know. The proposed model and methodology can be applied in industrial IC designs due to its effectiveness and efficiency.
Glaucoma is a condition of the eyes that results from damage to the optic nerve, which could potentially lead to loss of vision if not addressed promptly. Because glaucoma rarely shows early symptoms in the sufferer, ...
Glaucoma is a condition of the eyes that results from damage to the optic nerve, which could potentially lead to loss of vision if not addressed promptly. Because glaucoma rarely shows early symptoms in the sufferer, it requires regular observation of the retinal fundus by an ophthalmologist to find out if this eye disorder appears. Doctors’ observations are subjective, so they are inconsistent and take a long time. As a result, a computer-aided diagnostic (CAD) system was created that can automate the examination of retinal fundus images to detect glaucoma in its initial phase. In a consistent and time-saving manner by using optic disc and cup segmentation and cup-to-disc ratio (CDR) computation. CAD systems can also be used as decision support by doctors. Several previous image segmentation studies have proposed using convolution neuralnetwork (CNN) and Vision Transformer (ViT) based models and their combinations. However, the encoder-decoder model based on CNN is large and is slow in computation. The ViT model has the problem that the computational amount of the model increases when the image size also increases. Therefore, the segmentation method uses a Swin Transformer-based encoder-decoder model, Swin-Unet, which has the advantage of a self-attention mechanism performed on local windows and has linear computation. This paper presents a case study of optical disc and cup segmentation using the Swin-Unet method with the REFUGE dataset. The vCDR calculation with a threshold of 0.63 yields an accuracy of 94%. The IoU score results using the REFUGE dataset resulted in a score of 84% for the disc part and 80% for the cup part.
暂无评论