检索结果-内蒙古大学图书馆

Joint Attention-Guided Feature Fusion Network for Saliency Detection of Surface Defects

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Jiang, Xiaoheng Yan, Feng Lu, Yang Wang, Ke Guo, Shuai Zhang, Tianzhu Pang, Yanwei Niu, Jianwei Xu, Mingliang The School of Computer and Artificial Intelligence Zhengzhou University Engineering Research Center of Intelligent Swarm Systems Ministry of Education National Supercomputing Center in Zhengzhou Zhengzhou450001 China The School of Computer and Artificial Intelligence Zhengzhou University Zhengzhou450001 China The School of Information Science and Technology University of Science and Technology of China Hefei230026 China The School of Electrical Automation and Information Engineering Tianjin University Tianjin300072 China The State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beihang University Beijing100191 China Hangzhou Innovation Institute of Beihang University Hangzhou310051 China

Surface defect inspection plays an important role in the process of industrial manufacture and production. Though Convolutional Neural Network (CNN) based defect inspection methods have made huge leaps, they still confront a lot of challenges such as defect scale variation, complex background, low contrast, and so on. To address these issues, we propose a joint attention-guided feature fusion network (JAFFNet) for saliency detection of surface defects based on the encoder-decoder network. JAFFNet mainly incorporates a joint attention-guided feature fusion (JAFF) module into decoding stages to adaptively fuse low-level and high-level features. The JAFF module learns to emphasize defect features and suppress background noise during feature fusion, which is beneficial for detecting low-contrast defects. In addition, JAFFNet introduces a dense receptive field (DRF) module following the encoder to capture features with rich context information, which helps detect defects of different scales. The JAFF module mainly utilizes a learned joint channel-spatial attention map provided by high-level semantic features to guide feature fusion. The attention map makes the model pay more attention to defect features. The DRF module utilizes a sequence of multi-receptive-field (MRF) units with each taking as inputs all the preceding MRF feature maps and the original input. The obtained DRF features capture rich context information with a large range of receptive fields. Extensive experiments conducted on SD-saliency-900, Magnetic tile, and DAGM 2007 indicate that our method achieves promising performance in comparison with other state-of-the-art methods. Meanwhile, our method reaches a real-time defect detection speed of 66 FPS. Copyright © 2024, The Authors. All rights reserved.

关键词： Feature extraction

A Mother-Son Model for Multi-Objective Non-Invasive Load Monitoring

学校读者我要写书评

暂无评论

SSRN

SSRN 2023年

作者： Mei, Huawei Liu, Yanping Cao, Wangbin Yu, Yang North China Electric Power University Baoding071003 China Engineering Research Center of Intelligent Computing for Complex Energy Systems Ministry of Education Baoding071003 China Hebei Key Laboratory of Power Internet of Things Technology North China Electric Power University Baoding071003 China State Key Laboratory of Alternate Electrical Power System with Renewable Energy Sources North China Electric Power University Baoding071003 China

This paper proposes a mother-son model (MSM) to address the challenges of missing data, complex models, and limited transfer capabilities in non-intrusive load monitoring (NILM). The MSM model designs a novel transfer method based on feature inheritance to dynamically decompose multiple appliances (including unknown appliances). The mother model incorporates a six-parallel feature extraction structure to extract comprehensive features, which are then inherited by the son model. The features inherited from the mother model integrate information from multiple dimensions in the spatial domain and focus on local fine features in the temporal domain. The son model offers the capability to adjust the number of appliances and decompose unknown appliances, catering to the requirements of practical applications of NILM. Furthermore, a novel statistical metric, Ratio Squared Error (RSE), is designed to quantify the proportion of squared error in energy consumption. The experiments are carried out on five households and statistically evaluated using five statistical indicators. The results indicate that the son model exhibits superior decomposition performance and greater resilience compared to the state-of-the-art model. © 2023, The Authors. All rights reserved.

关键词： Energy utilization

research on Attention-Based Predictive Model in Multi-Agent Reinforcement Learning

学校读者我要写书评

暂无评论

Research on Attention-Based Predictive Model in Multi-Agent ...

Chinese Automation Congress (CAC)

作者： Weixin Hong Huaiyu Wu Zhen Shen Gang Xiong Bin Hu Xisong Dong Fei-Yue Wang The State Key Laboratory for Management and Control of Complex Systems Institute of Automation Chinese Academy of Sciences Beijing China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China The Beijing Engineering Research Center of Intelligent Systems and Technology Institute of Automation Chinese Academy of Sciences Beijing China The Guangdong Engineering Research Center of 3D Printing and Intelligent Manufacturing Cloud Computing Center Chinese Academy of Sciences Dongguan China

Agent actions planning is a challenging problem in multi-agent reinforcement learning. Recent methods typically build their predictive models by full connection layers, but the shortage of utilizing action and observation information in complex multi-agent environment limits the performance of those methods. To address this issue, we propose a novel predictive model based on self-attention mechanism which can effectively use information in the environment. Specifically, we use the MADDPG algorithm to make a dataset where the input is the observations and actions and the output is the predicted observations and rewards. We also introduce the multi-head attention mechanism into the predictive model so that the predictive model can better combine different information for prediction. We perform extensive experiments to assess the proposed method and compare it with the representative baseline approach. Results demonstrate that our method outperforms competitors with higher accuracy in different tasks. Our implementation will be publicly available.

关键词： Automation Reinforcement learning Predictive models Prediction algorithms Planning Task analysis

Adaptive Wavelet Filters as Practical Texture Feature Amplifiers for Parkinson’s Disease Screening in OCT

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Zhang, Xiaoqing Shi, Hanfeng Li, Xiangyu Ye, Haili Xu, Tao Li, Na Hu, Yan Lv, Fan Chen, Jiangfan Liu, Jiang Center for High Performance Computing and Shenzhen Key Laboratory of Intelligent Bioinformatics Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen China Research Institute of Trustworthy Autonomous Systems Department of Computer Science and Engineering Southern University of Science and Technology Shenzhen518055 China State Key Laboratory of Ophthalmology Optometry and Vision Science Wenzhou Medical University Wenzhou China Centre for Computational Science and Mathematical Modelling Coventry University Coventry United Kingdom School of Computer Science University of Nottingham Ningbo China Ningbo315100 China School of Ophthalmology and Optometry Wenzhou Medical University Wenzhou325035 China Department of Electronic and Information Engineering Changchun University Changchun130022 China

Parkinson’s disease (PD) is a prevalent neurodegenerative disorder globally. The eye’s retina is an extension of the brain and has great potential in PD screening. Recent studies have suggested that texture features extracted from retinal layers can be adopted as biomarkers for PD diagnosis under optical coherence tomography (OCT) images. Frequency domain learning techniques can enhance the feature representations of deep neural networks (DNNs) by decomposing frequency components involving rich texture features. Additionally, previous works have not exploited texture features for automated PD screening in OCT. Motivated by the above analysis, we propose a novel Adaptive Wavelet Filter (AWF) that serves as the Practical Texture Feature Amplifier to fully leverage the merits of texture features to boost the PD screening performance of DNNs with the aid of frequency domain learning. Specifically, AWF first enhances texture feature representation diversities via channel mixer, then emphasizes informative texture feature representations with the well-designed adaptive wavelet filtering token mixer. By combining the AWFs with the DNN stem, AWFNet is constructed for automated PD screening. Additionally, we introduce a novel Balanced Confidence (BC) Loss by mining the potential of sample-wise predicted probabilities of all classes and class frequency prior, to further boost the PD screening performance and trustworthiness of AWFNet. The extensive experiments manifest the superiority of our AWFNet and BC over state-of-the-art methods in terms of PD screening performance and trustworthiness. © 2025, CC BY-NC-SA.

关键词： Neurodegenerative diseases

Model-Driven Deep Learning for Non-Coherent Massive Machine-Type Communications

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Ma, Zhe Wu, Wen Gao, Feifei Shen, Xuemin The Institute for Artificial Intelligence Tsinghua University State Key Lab of Intelligent Technologies and Systems Beijing National Research Center for Information Science and Technology Department of Automation Tsinghua University Beijing100084 China The Frontier Research Center Peng Cheng Laboratory Guangdong Shenzhen518055 China The Department of Electrical and Computer Engineering University of Waterloo WaterlooONN2L 3G1 Canada

In this paper, we investigate the joint device activity and data detection in massive machine-type communications (mMTC) with a one-phase non-coherent scheme, where data bits are embedded in the pilot sequences and the base station simultaneously detects active devices and their embedded data bits without explicit channel estimation. Due to the correlated sparsity pattern introduced by the noncoherent transmission scheme, the traditional approximate message passing (AMP) algorithm cannot achieve satisfactory performance. Therefore, we propose a deep learning (DL) modified AMP network (DL-mAMPnet) that enhances the detection performance by effectively exploiting the pilot activity correlation. The DL-mAMPnet is constructed by unfolding the AMP algorithm into a feedforward neural network, which combines the principled mathematical model of the AMP algorithm with the powerful learning capability, thereby benefiting from the advantages of both techniques. Trainable parameters are introduced in the DL-mAMPnet to approximate the correlated sparsity pattern and the large-scale fading coefficient. Moreover, a refinement module is designed to further advance the performance by utilizing the spatial feature caused by the correlated sparsity pattern. Simulation results demonstrate that the proposed DL-mAMPnet can significantly outperform traditional algorithms in terms of the symbol error rate performance. © 2023, CC BY-NC-SA.

关键词： Message passing

Balanced Representation Learning for Long-tailed Skeleton-based Action Recognition

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Liu, Hongda Wang, Yunlong Ren, Min Hu, Junxing Luo, Zhengquan Hou, Guangqi Sun, Zhenan The School of Artificial Intelligence University of Chinese Academy of Sciences Beijing100049 China The Center for Research on Intelligent Perception and Computing State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation Chinese Academy of Sciences Beijing100190 China The School of Artificial Intelligence Beijing Normal University Beijing100875 China The University of Science and Technology of China Hefei230027 China

Skeleton-based action recognition has recently made significant progress. However, data imbalance is still a great challenge in real-world scenarios. The performance of current action recognition algorithms declines sharply when training data suffers from heavy class imbalance. The imbalanced data actually degrades the representations learned by these methods and becomes the bottleneck for action recognition. How to learn unbiased representations from imbalanced action data is the key to long-tailed action recognition. In this paper, we propose a novel balanced representation learning method to address the long-tailed problem in action recognition. Firstly, a spatial-temporal action exploration strategy is presented to expand the sample space effectively, generating more valuable samples in a rebalanced manner. Secondly, we design a detached action-aware learning schedule to further mitigate the bias in the representation space. The schedule detaches the representation learning of tail classes from training and proposes an action-aware loss to impose more effective constraints. Additionally, a skip-modal representation is proposed to provide complementary structural information. The proposed method is validated on four skeleton datasets, NTU RGB+D 60, NTU RGB+D 120, NW-UCLA, and Kinetics. It not only achieves consistently large improvement compared to the state-of-the-art (SOTA) methods, but also demonstrates a superior generalization capacity through extensive experiments. Our code is available at https://***/firework8/BRL. Copyright © 2023, The Authors. All rights reserved.

关键词： Learning systems

Bootstrap Masked Visual Modeling via Hard Patches Mining

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Wang, Haochen Fan, Junsong Wang, Yuxi Song, Kaiyou Wang, Tiancai Zhang, Xiangyu Zhang, Zhaoxiang The Center for Research on Intelligent Perception and Computing State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation Chinese Academy of Sciences Beijing100190 China The University of Chinese Academy of Sciences Beijing100190 China The Centre for Artificial Intelligence and Robotics Hong Kong Institute of Science & Innovation Chinese Academy of Sciences 999077 Hong Kong Megvii Technology Beijing100096 China

Masked visual modeling has attracted much attention due to its promising potential in learning generalizable representations. Typical approaches urge models to predict specific contents of masked tokens, which can be intuitively considered as teaching a student (the model) to solve given problems (predicting masked contents). Under such settings, the performance is highly correlated with mask strategies (the difficulty of provided problems). We argue that it is equally important for the model to stand in the shoes of a teacher to produce challenging problems by itself. Intuitively, patches with high values of reconstruction loss can be regarded as hard samples, and masking those hard patches naturally becomes a demanding reconstruction task. To empower the model as a teacher, we propose Hard Patches Mining (HPM), predicting patch-wise losses and subsequently determining where to mask. Technically, we introduce an auxiliary loss predictor, which is trained with a relative objective to prevent overfitting to exact loss values. Also, to gradually guide the training procedure, we propose an easy-to-hard mask strategy. Empirically, HPM brings significant improvements under both image and video benchmarks. Interestingly, solely incorporating the extra loss prediction objective leads to better representations, verifying the efficacy of determining where is hard to reconstruct. The code is available at https://***/Haochen-Wang409/HPM. Copyright © 2023, The Authors. All rights reserved.

关键词： Forecasting

Memory-Adaptive Vision-and-Language Navigation

学校读者我要写书评

暂无评论

SSRN

SSRN 2023年

作者： He, Keji Jing, Ya Huang, Yan Lu, Zhihe An, Dong Wang, Liang Center for Research on Intelligent Perception and Computing State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation Chinese Academy of Sciences Beijing China School of Artificial Intelligence University of Chinese Academy of Sciences Beijing China ByteDance AI Lab Beijing China National University of Singapore Singapore School of Future Technology University of Chinese Academy of Sciences Beijing China

Vision-and-Language Navigation (VLN) requests an agent to navigate in 3D environments following given instructions, where history is critical for decisionmaking in dynamic navigation process. Particularly, a memory bank storing histories is widely used in existing methods to incorporate with multimodel representations in current scenes for better decision-making. However, by weighting each history with a simple scalar, those methods cannot purely utilize the informative cues that co-exist with detrimental contents in each history, thereby inevitably introducing noises into decision-making. To that end, we propose a novel Memory-Adaptive Model (MAM) that can dynamically restrain the detrimental contents in histories for retaining contents that benefit navigation only. Specifically, two key modules, Visual and Textual Adaptive Modules, are designed to restrain history noises based on scene-related vision and text, respectively. A Reliability Estimator Module is further introduced to refine above adaptation operations. Our experiments on the widely used RxR and R2R datasets show that MAM outperforms its baseline method by 4.0% / 2.5% and 2% / 1% on the validation unseen/test split, respectively, wrt the SR metric. © 2023, The Authors. All rights reserved.

关键词： Navigation

Efficient Pyramid Channel Attention Network for Pathological Myopia Recognition

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Zhang, Xiaoqing Zhao, Jilu Li, Yan Wu, Hao Zhou, Xiangtian Liu, Jiang Research Institute of Trustworthy Autonomous Systems Department of Computer Science and Engineering Southern University of Science and Technology Shenzhen518055 China Center for High Performance Computing Shenzhen Key Laboratory of Intelligent Bioinformatics Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China National Clinical Research Center for Ocular Diseases Eye Hospital Wenzhou Medical University Wenzhou325027 China State Key Laboratory of Ophthalmology Optometry and Visual Science Eye Hospital Wenzhou Medical University Wenzhou325027 China Research Unit of Myopia Basic Research and Clinical Prevention and Control Chinese Academy of Medical Sciences Wenzhou325027 China Singapore Eye Research Institute 169856 Singapore

Pathological myopia (PM) is the leading ocular disease for impaired vision worldwide. Clinically, the characteristic of pathology distribution in PM is global-local on the fundus image, which plays a significant role in assisting clinicians in diagnosing PM. However, most existing deep neural networks focused on designing complex architectures but rarely explored the pathology distribution prior of PM. To tackle this issue, we propose an efficient pyramid channel attention (EPCA) module, which fully leverages the potential of the clinical pathology prior of PM with pyramid pooling and multi-scale context fusion. Then, we construct EPCA-Net for automatic PM recognition based on fundus images by stacking a sequence of EPCA modules. Moreover, motivated by the recent pretraining-and-finetuning paradigm, we attempt to adapt pre-trained natural image models for PM recognition by freezing them and treating the EPCA and other attention modules as adapters. In addition, we construct a PM recognition benchmark termed PM-fundus by collecting fundus images of PM from publicly available datasets. The comprehensive experiments demonstrate the superiority of EPCA-Net over state-of-the-art methods in the PM recognition task. For example, EPCA-Net achieves 97.56% accuracy and outperforms ViT by 2.85% accuracy on the PM-fundus dataset. The results also show that our method based on the pretraining-and-finetuning paradigm achieves competitive performance through comparisons to part of previous methods based on traditional fine-tuning paradigm with fewer tunable parameters, which has the potential to leverage more natural image foundation models to address the PM recognition task in limited medical data regime. Copyright © 2023, The Authors. All rights reserved.

关键词： Pathology