检索结果-内蒙古大学图书馆

An Self-supervised Learning & Self-attention Based Method for Defects Classification on PCB Surface images

学校读者我要写书评

暂无评论

An Self-supervised Learning & Self-attention Based Method fo...

International Conference on Electronics, Communications and Information Technology (CECIT)

作者： Lijie Zhou Xufeng Ling Shan Zhu Zheng Sun Jie Yang AI School Tianhua College Shanghai Normal University Shanghai China ASIC Motor Corporation Limited China Institute of Image Processing and Pattern Recognition Shanghai Jiao tong University China

ISBN: (纸本)9781665437585

Automatic detection of PCB defects become a difficult work in electronics industry, with the rapid development of Integrated Circuit. A good detection method can effectively improve production efficiency and reduce the costs of quality inspection. The traditional image processing methods have the backwards of complicated system structure, difficult image segmentation, and low detection accuracy, etc. In order to solve the above problems, this paper proposes a method of extracting features by self-supervised learning with supervised learning to complete the classification task. This method uses a deep neural network model based on self-supervised learning technology, uses multi-head self-attention mechanism; automatically recognize single or multiple defect areas in PCB, to extract defects features of PCB, and uses full connection classifier to classify features. The open-source (DeepPCB) is selected as the dataset, including 6 defect categories and non-defect categories. In the training process, data enhancement technology is used to increase the training samples, train the model and make it converge, and realize low error recognition on the verification dataset. The experimental results show that the features extracted by the self-supervised learning method are richer than those extracted by the supervised learning. The composite model formed by combining the self-attention mechanism has high accuracy and good robustness, reaches the classification accuracy of 94.33%, and has high accuracy and good generalization ability.

关键词： Training image segmentation Electronics industry Supervised learning Quality control Feature extraction Robustness

Zero-Shot Audio Captioning Using Soft and Hard Prompts

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Yiming Xu, Xuenan Du, Ruoyi Liu, Haohe Dong, Yuan Tan, Zheng-Hua Wang, Wenwu Ma, Zhanyu The Pattern Recognition and Intelligent System Laboratory School of Artificial Intelligence Beijing University of Posts and Telecommunications Beijing100876 China The Department of Computer Science and Engineering Shanghai Jiao Tong University Shanghai200240 China The Department of Electronic Systems Aalborg University Aalborg9220 Denmark The Centre for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

In traditional audio captioning methods, a model is usually trained in a fully supervised manner using a human-annotated dataset containing audio-text pairs and then evaluated on the test sets from the same dataset. Such methods have two limitations. First, these methods are often data-hungry and require time-consuming and expensive human annotations to obtain audio-text pairs. Second, these models often suffer from performance degradation in cross-domain scenarios, i.e., when the input audio comes from a different domain than the training set, which, however, has received little attention. We propose an effective audio captioning method based on the contrastive language-audio pre-training (CLAP) model to address these issues. Our proposed method requires only textual data for training, enabling the model to generate text from the textual feature in the cross-modal semantic space. In the inference stage, the model generates the descriptive text for the given audio from the audio feature by leveraging the audio-text alignment from CLAP. We devise two strategies to mitigate the discrepancy between text and audio embeddings: a mixed-augmentation-based soft prompt and a retrieval-based acoustic-aware hard prompt. These approaches are designed to enhance the generalization performance of our proposed model, facilitating the model to generate captions more robustly and accurately. Extensive experiments on AudioCaps and Clotho benchmarks show the effectiveness of our proposed method, which outperforms other zero-shot audio captioning approaches for in-domain scenarios and outperforms the compared methods for cross-domain scenarios, underscoring the generalization ability of our method. © 2024, CC BY.

关键词： Semantics

Two-dimensional multi-fiber spectrum image correction based on machine learning techniques

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Xu, Jiali Yin, Qian Guo, Ping Zheng, Xin Image Processing and Pattern Recognition Lab. School of Artificial Intelligence Beijing Normal University Beijing100875 China Image Processing and Pattern Recognition Lab School of Systems Science Beijing Normal University Beijing100875 China

Due to limited size and imperfect of the optical components in a spectrometer, aberration has inevitably been brought into two-dimensional multi-fiber spectrum image in LAMOST, which leads to obvious spacial variation of the point spread functions (PSFs). Consequently, if spatial variant PSFs are estimated directly, the huge storage and intensive computation requirements result in deconvolutional spectral extraction method become intractable. In this paper, we proposed a novel method to solve the problem of spatial variation PSF through image aberration correction. When CCD image aberration is corrected, PSF, the convolution kernel, can be approximated by one spatial invariant PSF only. Specifically, machine learning techniques are adopted to calibrate distorted spectral image, including Total Least Squares (TLS) algorithm, intelligent sampling method, multi-layer feed-forward neural networks. The calibration experiments on the LAMOST CCD images show that the calibration effect of proposed method is effectible. At the same time, the spectrum extraction results before and after calibration are compared, results show the characteristics of the extracted one-dimensional waveform are more close to an ideal optics system, and the PSF of the corrected object spectrum image estimated by the blind deconvolution method is nearly central symmetry, which indicates that our proposed method can significantly reduce the complexity of spectrum extraction and improve extraction accuracy. Copyright © 2020, The Authors. All rights reserved.

关键词： Optical transfer function

EXPLORING CONVOLUTIONAL NEURAL NETWORKS FOR RICE GRAIN CLASSIFICATION: AN EXPLAINABLE AI APPROACH

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Asif, Muhammad Junaid Khan, Hamza Tehseen, Rabia Rizvi, Syed Tahir Hussain Asad, Mujtaba Saqib, Shazia Ahmad, Rana Fayyaz Lahore Pakistan Islamabad44000 Pakistan Department of Electrical Engineering and Computer Sciences University of Stavanger Stavanger4021 Norway Lahore Pakistan Institute of Image Processing and Pattern Recognition Department of Automation SJTU China

Rice is an essential staple food worldwide that is important in promoting international trade, economic growth, and nutrition. Asian countries such as China, India, Pakistan, Thailand, Vietnam, and Indonesia are notable for their significant contribution to the cultivation and utilization of rice. These nations are also known for cultivating different rice grains, including short and long grains. These sizes are further classified as basmati, jasmine, kainat saila, ipsala, arborio, etc., catering to diverse culinary preferences and cultural traditions. For both local and international trade, inspecting and maintaining the quality of rice grains to satisfy customers and preserve a country's reputation is necessary. Manual quality check and classification is quite a laborious and time-consuming process. It is also highly prone to mistakes. Therefore, an automatic solution must be proposed for the effective and efficient classification of different varieties of rice grains. This research paper presents an automatic framework based on a convolutional neural network (CNN) for classifying different varieties of rice grains including basmati, jasmine, ipsala, arborio, and karacadag. The rice image dataset consists of 75000 images (15K images of each class of rice grains) and was used for training and testing. We evaluated the proposed model based on performance metrics such as accuracy, recall, precision, and F1-Score. The CNN model underwent rigorous training and validation, achieving a remarkable accuracy rate and a perfect area under each class's Receiver Operating Characteristic (ROC) curve. The confusion matrix analysis confirmed the model's effectiveness in distinguishing between the different rice varieties, indicating minimal misclassifications. Additionally, the integration of explainability techniques such as LIME (Local Interpretable Model-agnostic Explanations) and SHAP (SHapley Additive exPlanations) provided valuable insights into the model's decision-making

关键词： Grain (agricultural product)

Exploring Fusion Strategies for Accurate RGBT Visual Object Tracking

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Tang, Zhangyong Xu, Tianyang Li, Hui Wu, Xiao-Jun Zhu, XueFeng Kittler, Josef Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence School of Artificial Intelligence and Computer Science Jiangnan University Wuxi214122 China The Center for Vision Speech and Signal Processing University of Surrey GuildfordGU2 7XH United Kingdom

We address the problem of multi-modal object tracking in video and explore various options of fusing the complementary information conveyed by the visible (RGB) and thermal infrared (TIR) modalities including pixel-level, feature-level and decision-level fusion. Specifically, different from the existing methods, paradigm of image fusion task is heeded for fusion at pixel level. Feature-level fusion is fulfilled by attention mechanism with channels excited optionally. Besides, at decision level, a novel fusion strategy is put forward since an effortless averaging configuration has shown the superiority. The effectiveness of the proposed decision-level fusion strategy owes to a number of innovative contributions, including a dynamic weighting of the RGB and TIR contributions and a linear template update operation. A variant of which produced the winning tracker at the Visual Object Tracking Challenge 2020 (VOT-RGBT2020). The concurrent exploration of innovative pixel- and feature-level fusion strategies highlights the advantages of the proposed decision-level fusion method. Extensive experimental results on three challenging datasets, i.e., GTOT, VOT-RGBT2019, and VOT-RGBT2020, demonstrate the effectiveness and robustness of the proposed method, compared to the state-of-the-art approaches. Code will be shared at https://***/Zhangyong-Tang/DFAT. © 2022, CC BY.

关键词： Pixels

Parameter estimation of photovoltaic modules using analytical and numerical/iterative approaches: A comparative study

学校读者我要写书评

暂无评论

Materials Today: Proceedings 2022年 52卷 1-6页

作者： Souad Lidaighbi Mustapha Elyaqouti Khalid Assalaou Dris Ben Hmamou Driss Saadaoui Jihad H'roura Materials and Renewable Energy Laboratory Agadir Faculty of Sciences Ibn Zohr University BP 8106 80000 Agadir Morocco Laboratory of Electronics Signal Processing and Physical Modeling Faculty of Sciences of Agadir Ibn Zohr University BP 8106 80000 Agadir Morocco Laboratory of Images and Pattern Recognition - Intelligent and Communicating Systems Faculty of Sciences of Agadir Ibn Zohr University BP 8106 80000 Agadir Morocco

Modeling photovoltaic (PV) modules is fundamental for analyzing their efficiency and performance under different operating conditions. Generally, photovoltaic module modeling is based on a suitable equivalent circuit and a set of parameters representing the PV module's properties. Defining these parameters is not a trivial task, as they are usually not included in the technical documentation of the module. Therefore, the need to find suitable values for the model parameters becomes imperative. In this paper, we will test and compare two methods of extracting single-diode model (SDM) parameters: analytical and numerical, under standard test conditions (STC conditions). We examined the performance of six techniques: three analytical and three numerical. Except for Saleem technique, which tends to underestimate the I-V and P-V curves in the MPP zone, the results demonstrated that both approaches (analytical and iterative/numerical) are valid and accurate for predicting the I-V and P-V curves under STC conditions.

关键词： Photovoltaic module Single-diode model Parameters extraction Analytical methods Numerical methods

Learning from partially labeled data 28

学校读者我要写书评

暂无评论

Learning from partially labeled data

28th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, ESANN 2020

作者： Mehrkanoon, Siamak Huang, Xiaolin Suykens, Johan A.K. Department of Data Science and Knowledge Engineering Maastricht University Netherlands Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University China Department of Electrical Engineering ESAT-STADIUS KU Leuven LeuvenB-3001 Belgium

ISBN: (纸本)9782875870742

Providing sufficient labeled training data in many application domains is a laborious and costly task. Designing models that can learn from partially labeled data, or leveraging labeled data in one domain and unlabeled data in a different but related domain is of great interest in many applications. In particular, in this context one can refer to semi-supervised modelling, transfer learning, domain adaptation and multi-view learning among oth- ers. There are several possibilities for designing such models ranging from shallow to deep models. These type of models have received increasing in- terest due to their successful applications in real-life problems. This paper provides a brief overview of recent techniques in learning from partially labeled data. © ESANN 2020 - Proceedings, 28th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning.

关键词： Neural networks

Double Backpropagation for Training Autoencoders against Adversarial Attack

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Sun, Chengjin Chen, Sizhe Huang, Xiaolin Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University MOE Key Laboratory of System Control and Information Processing 800 Dongchuan Road Shanghai200240 China

Deep learning, as widely known, is vulnerable to adversarial samples. This paper focuses on the adversarial attack on autoencoders. Safety of the autoencoders (AEs) is important because they are widely used as a compression scheme for data storage and transmission, however, the current autoencoders are easily attacked, i.e., one can slightly modify an input but has totally different codes. The vulnerability is rooted the sensitivity of the autoencoders and to enhance the robustness, we propose to adopt double backpropagation (DBP) to secure autoencoder such as VAE and DRAW. We restrict the gradient from the reconstruction image to the original one so that the autoencoder is not sensitive to trivial perturbation produced by the adversarial attack. After smoothing the gradient by DBP, we further smooth the label by Gaussian Mixture Model (GMM), aiming for accurate and robust classification. We demonstrate in MNIST, CelebA, SVHN that our method leads to a robust autoencoder resistant to attack and a robust classifier able for image transition and immune to adversarial attack if combined with GMM. Copyright © 2020, The Authors. All rights reserved.

关键词： Gaussian distribution

Self-adapting RF Stealth Signal Design Method in RATR

学校读者我要写书评

暂无评论

Transactions of Nanjing University of Aeronautics and Astronautics 2021年第6期38卷 1020-1027页

作者： XIAO Yongsheng HUANG Lizhen HE Fengshou ZHOU Jianjiang Key Laboratory of Jiangxi Province for Image Processing and Pattern Recognition Nanchang Hangkong UniversityNanchang 330063P.R.China College of Electronic and Information Engineering Nanjing University of Aeronautics and AstronauticsNanjing 211106P.R.China Leihua Electronic Technology Research Institute Aviation Industry Corporation of ChinaLtd.Wuxi 214063P.R.China

Combining the mutual information theory and the sequential hypothesis testing(SHT)method,a selfadapting radio frequency(RF)stealth signal design method is proposed. The channel information is gained through the radar echo and feeds back to the radar system,and then the radar system adaptively designs the transmission waveform. So the close-loop system is formed. The correlations between these transmission waveforms are decreased because of the adaptive change of these transmission waveforms,and the number of illuminations is reduced for adopting the SHT,which lowers the transmission power of the radar system. The radar system using the new method possesses the RF stealth performance. Aiming at the application of radar automatic target recognition(RATR),experimental simulations show the effectiveness and feasibility of the proposed method.

关键词： radio frequency stealth sequential hypothesis testing mutual information close-loop system