检索结果-内蒙古大学图书馆

SSRN 2024年

作者： Liu, Yanhua Fang, Wenyu Huang, Wei Wang, Xiaofeng Zhao, Baokang Liu, Ximeng College of Computer and Data Science Fuzhou University Fuzhou350108 China Engineering Research Center of Big Data Intelligence Ministry of Education Fuzhou350108 China Fujian Key Laboratory of Network Computing and Intelligent Information Processing Fuzhou University Fuzhou350108 China College of Computer National University of Defense Technology Changsha410073 China

Fault detection is a research topic attracting much attention in IIoT. However, the continuous accumulation and growth of IIoT data leads to the catastrophic forgetting problem in the fault detection model and data heterogeneity, which creates a bottleneck for the performance and generalization of federated learning in fault detection. To improve the fault detection performance of federated learning models in data incremental scenarios, we propose a federatedincremental-learning-based fault detection method for IIoT, namely FIL-CAD. Firstly, comparing the knowledge distillation, the accuracies of different data classes in the global and local models are chosen as the model lightweight learning features, and the loss function is weighted. Secondly, we introduce the concept of data learning depth. It computes different model weights in the aggregation based on their degrees of data sample learning and model training participation and obtains the global model through weighted aggregation. Additionally, FIL-CAD supports the combination of differential privacy to protect data privacy. The proposed method is compared with four benchmark methods on four datasets, which include CWRU and MFPT bearing datasets. Then, the experimental results show that FIL-CAD performs optimally in accuracy and F1-Score, and the average accuracy is improved by 1.32%-18.52%, demonstrating the superiority of FIL-CAD. © 2024, The Authors. All rights reserved.

关键词： Fault detection

来源：评论

学校读者我要写书评

暂无评论

SSAM: a span spatial attention model for recognizing named entities

引用

Scientific Reports 2025年第1期15卷 1-13页

作者： Wang, Kai Wen, Kunjian Chen, Yanping Qin, Yongbin Text Computing & Cognitive Intelligence Engineering Research Center of National Education Ministry College of Computer Science and Technology Guizhou University Guiyang China State Key Laboratory of Public Big Data Guizhou University Guiyang China ByteDance Ltd. Beijing China

Mapping a sentence into a two-dimensional (2D) representation can flatten nested semantic structures and build multi-granular span dependencies in named entity recognition. Existing approaches to recognizing named entities often classify each entity span independently, which ignores the spatial structures between neighboring spans. To address this issue, we propose a Span Spatial Attention Model (SSAM) that consists of a token encoder, a span generation module, and a 2D spatial attention network. The SSAM employs a two-channel span generation strategy to capture multi-granular features. Unlike traditional attention implemented on a sequential sentence representation, spatial attention is applied to a 2D sentence representation, enabling the model to learn the spatial structures of the sentence. This allows the SSAM to adaptively encode important features and suppress non-essential information in the 2D sentence representation. Experimental results on the GENIA, ACE2005, and ACE2004 datasets demonstrate that our proposed model achieves state-of-the-art performance, with F1-scores of 81.82%, 89.04%, and 89.24%, respectively. The code is available at https://***/Gzuwkj/SpatialAttentionForNer. © The Author(s) 2025.

关键词： Named entity recognition Natural language processing Spatial attention

来源：评论

学校读者我要写书评

暂无评论

Deep Multi-kernel Clustering Network

Deep Multi-kernel Clustering Network

引用

IEEE International Conference on data mining (ICDM)

作者： Lina Ren Ruizhang Huang Shengwei Ma Yongbin Qin Yanping Chen Chuan Lin State Key Laboratory of Public Big Data Text Computing & Cognitive Intelligence Engineering Research Center of National Education Ministry College of Computer Science and Technology Guizhou University Guiyang China Department of Information Engineering Guizhou Light Industry Technical College Guiyang China

In this paper, a deep multi-kernel clustering network, named DMKCN, is proposed to learn a high-quality and structurally separable kernel representation for the clustering task. Specifically, a multi-kernel learner is proposed to choose a suitable kernel function by learning a suitable combination of kernel functions automatically. A kernel-aid encoder module, consisting of a series of multi-kernel learners, is proposed to learn the structurally separable kernel representation. Besides, a dual self-supervised mechanism, consisting of a kernel self-supervised strategy and a representation self-supervised strategy, is designed to uniformly optimize the kernel representation learning and structural partition. The kernel self-supervised strategy is developed to supervise the multi-kernel learners with the consideration of an objective of clustering task, the representation self-supervised strategy is developed to guide the optimization of kernel representation learning by reconstructing the raw data. Extensive experiments on six real-world datasets demonstrate the outstanding performance of our proposed DMKCN.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Modeling Temporal Dependencies within the Target for Long-Term Time Series Forecasting

arXiv

引用

arXiv 2024年

作者： Xiong, Qi Tang, Kai Ma, Minbo Zhang, Ji Xu, Jie Li, Tianrui School of Computing and Artificial Intelligence Engineering Research Center of Sustainable Urban Intelligent Transportation Ministry of Education National Engineering Laboratory of Integrated Transportation Big Data Application Technology Manufacturing Industry Chains Collaboration and Information Support Technology Key Laboratory of Sichuan Province Southwest Jiaotong University Chengdu611756 China School of Computing The University of Leeds LeedsLS2 9JT United Kingdom

Long-term time series forecasting (LTSF) is a critical task across diverse domains. Despite significant advancements in LTSF research, we identify a performance bottleneck in existing LTSF methods caused by the inadequate modeling of Temporal Dependencies within the Target (TDT). To address this issue, we propose a novel and generic temporal modeling framework, Temporal Dependency Alignment (TDAlign), that equips existing LTSF methods with TDT learning capabilities. TDAlign introduces two key innovations: 1) a loss function that aligns the change values between adjacent time steps in the predictions with those in the target, ensuring consistency with variation patterns, and 2) an adaptive loss balancing strategy that seamlessly integrates the new loss function with existing LTSF methods without introducing additional learnable parameters. As a plug-and-play framework, TDAlign enhances existing methods with minimal computational overhead, featuring only linear time complexity and constant space complexity relative to the prediction length. Extensive experiments on six strong LTSF baselines across seven real-world datasets demonstrate the effectiveness and flexibility of TDAlign. On average, TDAlign reduces baseline prediction errors by 1.47% to 9.19% and change value errors by 4.57% to 15.78%, highlighting its substantial performance improvements. Copyright © 2024, The Authors. All rights reserved.

关键词： Time series analysis

来源：评论

学校读者我要写书评

暂无评论

XoT (Xducation of Things): Harnessing AI and edge computing to educate all things

引用

IEEE Access 2024年

作者： Nurtantyana, Rio Hwang, Wu-Yuin Hariyanti, Uun Research Center for Data and Information Sciences Bandung Indonesia Telkom University School of Computing Indonesia Telkom University Center of Excellence Artificial Intelligence for Learning and Optimization Bandung Indonesia National Dong Hwa University College of Science and Engineering Department of Computer Science and Information Engineering Taiwan National Central University Graduate Institute of Network Learning Technology Taiwan Universitas Brawijaya Faculty of Computer Science Department of Information System Indonesia

Most English foreign language (EFL) studies focus solely on human beings. This research explores how edge computing can facilitate learning for all things. The XoT (Xducation of Things) framework was proposed to educate both human and all things. All things encompass two terms: AI-Agent and smartthings (covering physical and digital smart objects). At the core of this framework is Smart Question Answer Forwarding Mechanism (SQA-Forwarding), specifically designed to assist all things in building knowledge. To demonstrate this, the smartXoT environment was developed based on XoT framework, and its impacts on EFL learners was assessed. A quasi-experimental study involving 26 EFL learners, divided into an experimental group (EG) and a control group (CG), examined the differences in learning achievement of smartthings and EFL learners when using the smartXoT environment with/without SQA-Forwarding. Findings, on one hand, indicated that smartthings in the EG developed knowledge bases greater than those in the CG. On the other hand, the interaction between EFL learners and smartthings with SQA-Forwarding significantly improved learners' writing skills, with revisions playing a crucial role in enhancing writing quality. Thus, the XoT framework offers a novel and promising approach to educating both humans and all things. © 2013 IEEE.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

Hybrid Deep Relation Matrix Bidirectional Approach for Relational Triple Extraction

Hybrid Deep Relation Matrix Bidirectional Approach for Relat...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Yushuai Hu Jing Zhao Ming Li Lin Yuan Qingzhi Zou Ronghuan Zhang Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China School of Intelligence and Information Engineering Shandong University of Traditional Chinese Medicine Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

Relation extraction is a crucial task within information extraction, and numerous models have demonstrated impressive results. However, most of the tagging-based relation triple extraction methods employ unidirectional approaches to extract subjects, objects, and relations, which may overlook crucial information. In this paper, we introduce a novel deep matrix-based bidirectional relation extraction model. Firstly, we extract forward and backward entity pairs. During the bidirectional extraction process,there may be some redundant relationships,so we use a shared encoder to connect and enhance the extraction process. Secondly, we design a low-complexity relation extraction matrix to allocate all possible relations. We assess our model using diverse benchmark datasets, and comprehensive experiments show that our approach effectively addresses subsequent triple extraction issues stemming from entity extraction failures.

关键词： Learning systems Federated learning Computational modeling Benchmark testing Information retrieval data mining Task analysis

来源：评论

学校读者我要写书评

暂无评论

EFFICIENTLY PARAMETERIZED NEURAL METRIPLECTIC SYSTEMS

arXiv

引用

arXiv 2024年

作者： Gruber, Anthony Lee, Kookjin Lim, Haksoo Park, Noseong Trask, Nathaniel Center for Computing Research Sandia National Laboratories AlbuquerqueNM United States School of Computing and Augmented Intelligence Arizona State University TempeAZ United States Big Data Analytics Laboratory Yonsei University Seoul Korea Republic of Big Data Analytics Laboratory Korea Advanced Institute of Science and Technology Daejeon Korea Republic of School of Engineering and Applied Science University of Pennsylvania PhiladelphiaPA United States

Metriplectic systems are learned from data in a way that scales quadratically in both the size of the state and the rank of the metriplectic data. Besides being provably energy conserving and entropy stable, the proposed approach comes with approximation results demonstrating its ability to accurately learn metriplectic dynamics from data as well as an error estimate indicating its potential for generalization to unseen timescales when approximation error is low. Examples are provided which illustrate performance in the presence of both full state information as well as when entropic variables are unknown, confirming that the proposed approach exhibits superior accuracy and scalability without compromising on model expressivity. Copyright © 2024, The Authors. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Medical Image Segmentation Use Convolutional Attention Augmentation TransUNet with Skip Connection Enhancement

Medical Image Segmentation Use Convolutional Attention Augme...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Qingzhi Zou Jing Zhao Ming Li Ling Chen Lin Yuan Ronghuan Zhang Yushuai Hu Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China School of Intelligence and Information Engineering Shandong University of Traditional Chinese Medicine Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

The primary objective of medical image segmentation is the isolation of pathological tissues and distinct organs from medical images, thereby assisting in medical diagnosis. The methods employed for medical image segmentation encompass convolutional neural networks and transformer-based methods. Although the self-attention mechanism in Transformers improves its capability to capture long-range dependencies, it have limitations in learning local (contextual) relationships between pixels. Some previous research has tried to solve this problem by incorporating convolutional layers into the encoder or decoder of transformers, but sometimes feature inconsistencies arise. To better extract local features from images using convolutional neural networks and to fuse low-resolution and high-resolution features from higher-level and lower features, we propose the Convolutional Attention Augmentation TransUNet (CAA-TransUNet) model. In our model, firstly, we propose a convolutional attention augmentation module that enhances both local and global features by suppressing irrelevant background information. Secondly, we have integrated attention gates into the skip connections to aggregate feature information from various stages of the encoder during the upsampling process. Finally, we employ the technique of aggregating the loss of multi-stage features to expedite convergence speed and enhance performance. The experimental results on three public datasets demonstrate that our proposed model significantly outperforms the baseline methods.

关键词： Image segmentation Pathology Computational modeling Aggregates Logic gates Feature extraction Transformers

来源：评论

学校读者我要写书评

暂无评论

FEST: Feature Enhancement Swin Transformer for Remote Sensing Image Semantic Segmentation

FEST: Feature Enhancement Swin Transformer for Remote Sensin...

引用

International Conference on Computer Supported Cooperative Work in Design

作者： Ronghuan Zhang Jing Zhao Ming Li Qingzhi Zou Key Laboratory of Computing Power Network and Information Security Ministry of Education Shandong Computer Science Center Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Qilu University of Technology (Shandong Academy of Sciences) Jinan China Shandong Provincial Key Laboratory of Computer Networks Shandong Fundamental Research Center for Computer Science Jinan China School of Intelligence and Information Engineering Shandong University of Traditional Chinese Medicine Jinan China

ISBN: (数字)9798350349184

ISBN: (纸本)9798350349191

The global context is crucial for the precise segmentation of remote sensing images. However, the large volumes and high spatial resolutions of remote sensing images make efficient analysis of the entire scene challenging for most convolutional neural network (CNN)-based methods. To address this issue, we propose to design an innovative framework for semantic segmentation of remote sensing images called Feature Enhancement Swin Transformer (FEST). Firstly, we utilize the Swin Transformer as the encoder and incorporates a Global Information Enhancement Model (GIEM) within each Swin Transformer block to reduce information loss and enable encoding of more accurate spatial information. Secondly, we introduce an enhanced decoding structure called Enhanced Feature Fusion Module (EFFM) with added enhanced channel and spatial attention modules to retain localized information while obtaining extensive contextual information. Finally, for loss calculation, we utilize the dice and cross-entropy loss to jointly supervise the model, aiming to achieve a competitive performance. We comprehensively evaluated FEST on the ISPRS-Vaihingen and Potsdam datasets. The results indicate that our approach has achieved significant improvements in semantic segmentation tasks compared to existing methods.

关键词： Deep learning Federated learning Semantic segmentation Semantics Transformers Information retrieval Encoding

来源：评论

学校读者我要写书评

暂无评论

LGDB-Net: Dual-Branch Path for Building Extraction from Remote Sensing Image

LGDB-Net: Dual-Branch Path for Building Extraction from Remo...

引用

International Conference on Parallel and Distributed Systems (ICPADS)

ISBN: (数字)9798331515966

ISBN: (纸本)9798331515973

Extracting buildings from remote sensing images using deep learning techniques is a widely applied and crucial task. Convolutional Neural Networks (CNNs) adopt hierarchical feature representation, showcasing powerful capabilities in extracting local information but facing challenges in capturing global features. Transformers can address this limitation, but they perform poorly in extracting local features and significantly increase memory requirements and computational complexity. To overcome these challenges, we propose a method for building extraction from remote sensing images called LGDB-Net (Local-Global Dual-Branch Network), employing a dual-branch approach. Firstly, inspired by Swin Transformer, we designed GB-Former(Global Branch-Former) as the backbone network to model global information. We use a linear multi-head self-attention mechanism to reduce time and memory complexity while maintaining a large global receptive field. Additionally, we replace the traditional multi-layer perceptron with a convolution-enhanced multi-layer perceptron to improve channel feature representation, reduce model parameters, and enhance segmentation performance. Secondly, we use multiple Depth-wise Conv3×3 + LN (Layer Normalization) + GeLU (Gaussian Error Linear Unit) modules as the auxiliary branch for local detailed feature extraction. Finally, we adopt a multi-scale feature fusion strategy to integrate feature information from both branches. We conduct a series of experiments on three datasets: WHU, Massachusetts, and Inria. The experimental results demonstrate that the proposed method not only effectively improves segmentation accuracy with lower building omission and commission rates but also significantly reduces model parameters and computational complexity.

关键词： Accuracy Computational modeling Memory management Neural networks Feature extraction Transformers Sensors data mining Computational complexity Remote sensing

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：