检索结果-内蒙古大学图书馆

arXiv 2024年

作者： Yin, Yanlei Wang, Lihua Hoang, Dinh Thai Wang, Wenbo Niyato, Dusit The School of Mechanical and Electrical Engineering Kunming University of Science and Technology Kunming650500 China Australia The School of Mechanical and Electrical Engineering Yunnan Key Laboratory of Intelligent Control and Application Kunming University of Science and Technology Kunming650500 China The College of Computing and Data Science Nanyang Technological University Singapore639798 Singapore

In the process industry, long-term and efficient optimization of production lines requires real-time monitoring and analysis of operational states to fine-tune production line parameters. However, complexity in operational logic and intricate coupling of production process parameters make it difficult to develop an accurate mathematical model for the entire process, thus hindering the deployment of efficient optimization mechanisms. In view of these difficulties, we propose to deploy a digital twin of the production line by encoding its operational logic in a data-driven approach. By iteratively mapping the real-world data reflecting equipment operation status and product quality indicators in the digital twin, we adopt a quality prediction model for production process based on self-attention-enabled temporal convolutional neural networks. This model enables the data-driven state evolution of the digital twin. The digital twin takes a role of aggregating the information of actual operating conditions and the results of quality-sensitive analysis, which facilitates the optimization of process production with virtual-reality evolution. Leveraging the digital twin as an information-flow carrier, we extract temporal features from key process indicators and establish a production process quality prediction model based on the proposed deep neural network. Our operation experiments on a specific tobacco shredding line demonstrate that the proposed digital twin-based production process optimization method fosters seamless integration between virtual and real production lines. This integration achieves an average operating status prediction accuracy of over 98% and a product quality acceptance rate of over 96%. Copyright © 2024, The Authors. All rights reserved.

关键词： Convolutional neural networks

来源：评论

学校读者我要写书评

暂无评论

Improving Complex Reasoning over Knowledge Graph with Logic-Aware Curriculum Tuning

arXiv

引用

arXiv 2024年

作者： Xia, Tianle Ding, Liang Wan, Guojia Zhan, Yibing Du, Bo Tao, Dacheng School of Computer Science National Engineering Research Center for Multimedia Software Institute of Artificial Intelligence Hubei Key Laboratory of Multimedia and Network Communication Engineering Wuhan University China The University of Sydney Australia JD Explore Academy China College of Computing and Data Science Nanyang Technological University Singapore639798 Singapore

Answering complex queries over incomplete knowledge graphs (KGs) is a challenging task. Most previous works have focused on learning entity/relation embeddings and simulating first-order logic operators with various neural networks. However, they are bottlenecked by the inability to share world knowledge to improve logical reasoning, thus resulting in suboptimal performance. In this paper, we propose a complex reasoning schema over KG upon large language models (LLMs), containing a curriculum-based logical-aware instruction tuning framework, named LACT. Specifically, we augment the arbitrary first-order logical queries via binary tree decomposition, to stimulate the reasoning capability of LLMs. To address the difficulty gap among different types of complex queries, we design a simple and flexible logic-aware curriculum learning framework. Experiments across widely used datasets demonstrate that LACT has substantial improvements (brings an average +5.5% MRR score) over advanced methods, achieving the new state-of-the-art. Copyright © 2024, The Authors. All rights reserved.

关键词： Binary trees

来源：评论

学校读者我要写书评

暂无评论

Deep Generative Network for Image Inpainting with Gradient Semantics and Spatial-Smooth Attention

SSRN

引用

SSRN 2023年

作者： Sheng, Ziqi Xu, Wenbo Lin, Cong Lu, Wei School of Computer Science and Engineering Guangdong Province Key Laboratory of Information Security Technology Ministry of Education Key Laboratory of Machine Intelligence and Advanced Computing Sun Yat-sen University Guangzhou510006 China Applied Laboratory of Dig Data and Education Statistics School of Statistics and Mathematics Guangdong University of Finance and Economics Guangzhou510006 China

As a powerful means of tampering in image content security area, image inpainting based on deep generative networks can yield visually appealing outputs but often produces ambiguous artifacts, particularly in boundary and high semantic areas. To address this issue, a novel end-to-end network with gradient semantics and spatial-smooth attention (GS-SSA) is proposed, which combines a gradient learning network and an image inpainting network. The gradient learning network is meant to properly anticipate the gradient semantics in the hole region and get a complete gradient semantic map. The image inpainting network utilizes the complete gradient semantic map to better repair the missing pixels and obtain the final inpainting results. Moreover, spatial-smooth attention is introduced into the image inpainting network, considering the spatial structural relations and the surrounding information in the hole region respectively. © 2023, The Authors. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Penta-Encoder with Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation

Penta-Encoder with Medical Transformer for Incomplete Multim...

引用

International Conference on Signal Processing Proceedings (ICSP)

作者： Guohui Yu Lihui Wang Qijian Chen Li Wang Kun Tang Xinyu Cheng Yuemin Zhu State Key Laboratory of Public Big Data College of Computer Science and Technology Key Laboratory of Intelligent Medical Image Analysis and Precise Diagnosis of Guizhou Province Engineering Research Center of Text Computing & Cognitive Intelligence Ministry of Education Guizhou University Guiyang China INSA Lyon CNRS Inserm CREATIS UMR 5220 U1206 Univ Lyon Lyon France

ISBN: (数字)9798350387384

ISBN: (纸本)9798350387391

Accurate brain tumor segmentation of magnetic resonance imaging (MRI) images requires the integration of multimodal data in effective collaborative learning. However, clinical scenarios often face missing modalities, significantly impacting segmentation performance. In this paper, we propose the penta-encoder with medical transformer (Penta-MedTrans) for incomplete multimodal learning, which consists of four main components: a modality-specific encoder (MSE), a modality-dynamic encoder (MDE), a multimodal fusion module (MMFM) and a convolutional decoder. The MSE extracts unique features for each modality, while the MDE captures inter-modal semantics to address missing modalities. The MMFM establishes and aligns long-range correlations between modal-invariant features and global semantics of tumor regions. The convolutional decoder generates robust segmentation results by progressively upsampling and fusing modality-invariant features. We extensively validated our method on the BraTS 2020 and BraTS 2021 datasets for brain tumor segmentation. Results showed that our method outperforms SOTA for incomplete multimodal brain tumor segmentation across most subsets.

关键词： Image segmentation Correlation Convolution Magnetic resonance imaging Semantics Brain tumors Transformers Feature extraction Decoding Biomedical imaging

来源：评论

学校读者我要写书评

暂无评论

OFFLINE MODEL-BASED OPTIMIZATION BY LEARNING TO RANK

arXiv

引用

arXiv 2024年

作者： Tan, Rong-Xi Xue, Ke Lyu, Shen-Huan Shang, Haopu Wang, Yao Wang, Yaoyuan Fu, Sheng Qian, Chao National Key Laboratory for Novel Software Technology Nanjing University China School of Artificial Intelligence Nanjing University China Key Laboratory of Water Big Data Technology of Ministry of Water Resources Hohai University China College of Computer Science and Software Engineering Hohai University China Advanced Computing and Storage Lab Huawei Technologies Co. Ltd. China

Offline model-based optimization (MBO) aims to identify a design that maximizes a black-box function using only a fixed, pre-collected dataset of designs and their corresponding scores. This problem has garnered significant attention from both scientific and industrial domains. A common approach in offline MBO is to train a regression-based surrogate model by minimizing mean squared error (MSE) and then find the best design within this surrogate model by different optimizers (e.g., gradient ascent). However, a critical challenge is the risk of out-of-distribution errors, i.e., the surrogate model may typically overestimate the scores and mislead the optimizers into suboptimal regions. Prior works have attempted to address this issue in various ways, such as using regularization techniques and ensemble learning to enhance the robustness of the model, but it still remains. In this paper, we argue that regression models trained with MSE are not well-aligned with the primary goal of offline MBO, which is to select promising designs rather than to predict their scores precisely. Notably, if a surrogate model can maintain the order of candidate designs based on their relative score relationships, it can produce the best designs even without precise predictions. To validate it, we conduct experiments to compare the relationship between the quality of the final designs and MSE, finding that the correlation is really very weak. In contrast, a metric that measures order-maintaining quality shows a significantly stronger correlation. Based on this observation, we propose learning a ranking-based model that leverages learning to rank techniques to prioritize promising designs based on their relative scores. We show that the generalization error on ranking loss can be well bounded. Empirical results across diverse tasks demonstrate the superior performance of our proposed ranking-based method than twenty existing methods. Our implementation is available at https://***/lam

关键词： Linear regression

来源：评论

学校读者我要写书评

暂无评论

Resilient Collaborative Caching for Multi-Edge Systems with Robust Federated Deep Learning

引用

IEEE/ACM Transactions on Networking 2024年

作者： Chen, Zheyi Liang, Jie Yu, Zhengxin Cheng, Hongju Min, Geyong Li, Jie Fuzhou University College of Computer and Data Science Fujian Key Laboratory of Network Computing and Intelligent Information Processing Fuzhou350116 China Ministry of Education Engineering Research Center of Big Data Intelligence Fuzhou350002 China Lancaster University School of Computing and Communications LancasterLA1 4YW United Kingdom University of Exeter Faculty of Environment Science and Economy Department of Computer Science ExeterEX4 4QF United Kingdom Shanghai Jiao Tong University Department of Computer Science and Engineering Shanghai200240 China

As a key technique for future networks, the performance of emerging multi-edge caching is often limited by inefficient collaboration among edge nodes and improper resource configuration. Meanwhile, achieving optimal cache hit rates poses substantive challenges without effectively capturing the potential relations between discrete user features and diverse content libraries. These challenges become further sophisticated when caching schemes are exposed to adversarial attacks that seriously impair cache performance. To address these challenges, we introduce RoCoCache, a resilient collaborative caching framework that uniquely integrates robust federated deep learning with proactive caching strategies, enhancing performance under adversarial conditions. First, we design a novel partitioning mechanism for multi-dimensional cache space, enabling precise content recommendations in user classification intervals. Next, we develop a new Discrete-Categorical Variational Auto-Encoder (DC-VAE) to accurately predict content popularity by overcoming posterior collapse. Finally, we create an original training mode and proactive cache replacement strategy based on robust federated deep learning. Notably, the residual-based detection for adversarial model updates and similarity-based federated aggregation are integrated to avoid the model destruction caused by adversarial updates, which enables the proactive cache replacement adapting to optimized cache resources and thus enhances cache performance. Using the real-world testbed and datasets, extensive experiments verify that the RoCoCache achieves higher cache hit rates and efficiency than state-of-the-art methods while ensuring better robustness. Moreover, we validate the effectiveness of the components designed in RoCoCache for improving cache performance via ablation studies. © 1993-2012 IEEE.

关键词： cache space partitioning content popularity prediction Multi-edge collaborative caching proactive cache replacement robust federated deep learning

来源：评论

学校读者我要写书评

暂无评论

Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Models

引用

IEEE Transactions on Vehicular Technology 2025年

作者： Liu, Chuanhong Guo, Caili Yang, Yang Chen, Mingzhe Quek, Tony Q. S. Beijing University of Posts and Telecommunications Beijing Key Laboratory of Network System Architecture and Convergence School of Information and Communication Engineering Beijing100876 China Beijing University of Posts and Telecommunications Beijing Laboratory of Advanced Information Networks School of Information and Communication Engineering Beijing100876 China University of Miami Department of Electrical and Computer Engineering Institute for Data Science and Computing Coral GablesFL United States Singapore University of Technology and Design Dept. of Information Systems Technology and Design 487372 Singapore

Recent studies have focused on leveraging large-scale artificial intelligence (LAI) models to improve semantic representation and compression capabilities. However, the substantial computational demands of LAI models pose significant challenges for real-time communication scenarios. To address this, this paper proposes utilizing knowledge distillation (KD) techniques to extract and condense knowledge from LAI models, effectively reducing model complexity and computation latency. Nevertheless, the inherent complexity of LAI models leads to prolonged inference times during distillation, while their lack of channel awareness compromises the distillation performance. These limitations make standard KD methods unsuitable for task-oriented semantic communication scenarios. To address these issues, we propose a fast distillation method featuring a pre-stored compression mechanism that eliminates the need for repetitive inference, significantly improving efficiency. Furthermore, a channel adaptive module is incorporated to dynamically adjust the transmitted semantic information based on varying channel conditions, enhancing communication reliability and adaptability. In addition, an information bottleneck-based loss function is derived to guide the fast distillation process. Simulation results verify that the proposed scheme outperform baselines in term of task accuracy, model size, computation latency, and training data requirements. © 1967-2012 IEEE.

关键词： NP-hard

来源：评论

学校读者我要写书评

暂无评论

A review of federated learning technology and its research progress in healthcare applications

引用

Applied Intelligence 2025年第10期55卷 1-30页

作者： Ma, Zezhong Ruhaiyem, Nur Intan Raihana Zhang, Meng Musa, Kamarul Imran Hanis, Tengku Muhammad Xiao, Tianyun Hua, Dianbo Li, Hao School of Computer Sciences Universiti Sains Malaysia Gelugor Malaysia Beijing Sitairui Cancer Data Analysis Joint Laboratory Beijing China School of Cyberspace Security (School of Cryptology) Hainan University Haikou China School of Medical Sciences Universiti Sains Malaysia Kelantan Malaysia Department of Community Medicine Faculty of Medicine Universiti Sultan Zainal Abidin Medical Campus Kuala Terengganu Malaysia Hebei Key Laboratory of Data Science and Application North China University of Science and Technology Tangshan China College of Science North China University of Science and Technology Tangshan China The Key Laboratory of Engineering Computing in Tangshan City North China University of Science and Technology Tangshan China

data-driven medical applications, powered by big data and artificial intelligence, generate scalable models from extensive datasets. This innovation attracts both academia and industry, significantly enhancing healthcare quality while posing integration challenges. Federated learning emerges as a transformative approach in healthcare, facilitating collaborative machine learning while preserving data privacy. This article reviews research on federated learning in healthcare, utilizing the "Web of Science" database to examine development trends and application progress. Initially, the federated learning system is dissected, and its application methods are analyzed, summarizing 18 federated learning frameworks and 9 privacy-preserving methods suitable for federated learning, and exploring its limitations in healthcare applications. Subsequently, recent literature on federated learning in four major areas—disease diagnosis and risk assessment, medical image analysis, drug discovery and development, and disease management—is reviewed, summarizing the general process of applying Federated Learning in healthcare. Finally, the challenges faced by federated learning in the medical field and the solutions currently being explored by scholars are summarized. This article aims to comprehensively summarize the research progress and application trends of federated learning technology in the medical field, analyze its limitations and challenges, and anticipate its future development to further promote sustainable advancement in the healthcare industry.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Suppress content shift: better diffusion features via off-the-shelf generation techniques 24

Suppress content shift: better diffusion features via off-th...

引用

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Benyuan Meng Qianqian Xu Zitai Wang Zhiyong Yang Xiaochun Cao Qingming Huang Institute of Information Engineering CAS and School of Cyber Security University of Chinese Academy of Sciences Key Lab. of Intelligent Information Processing Institute of Computing Technology CAS and Peng Cheng Laboratory Key Lab. of Intelligent Information Processing Institute of Computing Technology CAS School of Computer Science and Tech. University of Chinese Academy of Sciences School of Cyber Science and Tech. Shenzhen Campus of Sun Yat-sen University School of Computer Science and Tech. University of Chinese Academy of Sciences and Key Lab. of Intelligent Information Processing Institute of Computing Technology CAS and Key Laboratory of Big Data Mining and Knowledge Management CAS

ISBN: (纸本)9798331314385

Diffusion models are powerful generative models, and this capability can also be applied to discrimination. The inner activations of a pre-trained diffusion model can serve as features for discriminative tasks, namely, diffusion feature. We discover that diffusion feature has been hindered by a hidden yet universal phenomenon that we call content shift. To be specific, there are content differences between features and the input image, such as the exact shape of a certain object. We locate the cause of content shift as one inherent characteristic of diffusion models, which suggests the broad existence of this phenomenon in diffusion feature. Further empirical study also indicates that its negative impact is not negligible even when content shift is not visually perceivable. Hence, we propose to suppress content shift to enhance the overall quality of diffusion features. Specifically, content shift is related to the information drift during the process of recovering an image from the noisy input, pointing out the possibility of turning off-the-shelf generation techniques into tools for content shift suppression. We further propose a practical guideline named GATE to efficiently evaluate the potential benefit of a technique and provide an implementation of our methodology. Despite the simplicity, the proposed approach has achieved superior results on various tasks and datasets, validating its potential as a generic booster for diffusion features. Our code is available at https://***/Darkbblue/diffusion-content-shift.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Enhancing EEG-Based Cross-Subject Emotion Recognition via Adaptive Source Joint Domain Adaptation

引用

IEEE Transactions on Affective computing 2024年

作者： Liu, Ke Luo, Xin Zhu, Wenrui Yu, Zhuliang Yu, Hong Xiao, Bin Wu, Wei Chongqing University of Posts and Telecommunications School of Computer Science and Technology Chongqing400065 China Chongqing University of Posts and Telecommunications Key Laboratory of Big Data Intelligent Computing China South China University of Technology College of Automation Science and Engineering Guangzhou510641 China Shanghai Jiao Tong University School of Medicine Department of Neurology Songjjiang Hospital and Songjiang Research Institute Shanghai Key Laboratory of Emotions and Affective Disorders Shanghai201600 China

EEG emotion recognition is crucial in both human-machine interaction and healthcare. However, recognizing emotions across different subjects remains challenging due to individual variability. While existing multi-source domain adaptation methods have been utilized for cross-subject EEG emotion decoding, they often struggle with irrelevant or weakly relevant source domains, leading to negative transfer. Additionally, variations within subdomains are often neglected in these studies. We propose a joint domain adaptation method, Adaptive Source Joint Domain Adaptation (ASJDA) to address these issues. ASJDA utilizes an unsupervised adaptive source selection strategy to select a subset of source domains by evaluating the Jensen-Shannon divergence between the source and target domains, choosing those most relevant to the target. Subsequently, it implements joint domain adaptation with these chosen sources at both the domain and category subdomain levels. Our proposed method outperforms existing state-of-the-art methods, achieving cross-subject accuracies of 96.81% in SEED, 89.69% in SEED-IV, and 69.31% in DEAP. This work significantly advances the state of the art in EEG emotion recognition by effectively addressing the challenges of cross-subject variability. The source code for ASJDA is available at https://***/Pam098/ASJDA. © 2010-2012 IEEE.

关键词： adaptive source selection cross-subject domain adaptation EEG emotion recognition

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：