检索结果-内蒙古大学图书馆

MLFuse: Multi-Scenario Feature Joint Learning for Multi-Modality Image Fusion

IEEE Transactions on Multimedia 2025年

作者： Lei, Jia Li, Jiawei Liu, Jinyuan Wang, Bin Zhou, Shihua Zhang, Qiang Wei, Xiaopeng Kasabov, Nikola K. Dalian University Key Laboratory of Advanced Design and Intelligent Computing Ministry of Education School of Software Engineering Dalian116622 China University of Science and Technology Beijing School of Computer and Communication Engineering Beijing100083 China Dalian University of Technology School of Mechanical Engineering Dalian116024 China Dalian University of Technology School of Computer Science and Technology Dalian116024 China Auckland University of Technology Knowledge Engineering and Discovery Research Institute Auckland1010 New Zealand Ulster University Intelligent Systems Research Center LondonderryBT52 1SA United Kingdom

Multi-modality image fusion (MMIF) entails synthesizing images with detailed textures and prominent objects. Existing methods tend to use general feature extraction to handle different fusion tasks. However, these methods have difficulty breaking fusion barriers across various modalities owing to the lack of targeted learning routes. In this work, we propose a multi-scenario feature joint learning architecture, MLFuse, that employs the commonalities of multi-modality images to deconstruct the fusion progress. Specifically, we construct a cross-modal knowledge reinforcing network that adopts a multipath calibration strategy to promote information communication between different images. In addition, two professional networks are developed to maintain the salient and textural information of fusion results. The spatial-spectral domain optimizing network can learn the vital relationship of the source image context with the help of spatial attention and spectral attention. The edge-guided learning network utilizes the convolution operations of various receptive fields to capture image texture information. The desired fusion results are obtained by aggregating the outputs from the three networks. Extensive experiments demonstrate the superiority of MLFuse for infrared-visible image fusion and medical image fusion. The excellent results of downstream tasks (i.e., object detection and semantic segmentation) further verify the high-quality fusion performance of our method. The code is publicly available at https://***/jialei-sc/MLFuse. © 1999-2012 IEEE.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Technical Report: On the Convergence of Gossip Learning in the Presence of Node Inaccessibility

arXiv

引用

arXiv 2024年

作者： Liu, Tian Cui, Yue Hu, Xueyang Xu, Yecheng Liu, Bo Zhejiang Laboratory Hangzhou China Department of Computer Science and Computer Information Systems Auburn University at Montgomery Montgomery United States Department of Computer Science and Software Engineering Auburn University Auburn United States Institute of Rural Development Zhejiang Academy of Agricultural Sciences Hangzhou China DBAPPSecurity Co. Ltd. Hangzhou China

Gossip learning (GL), as a decentralized alternative to federated learning (FL), is more suitable for resource-constrained wireless networks, such as Flying Ad-Hoc Networks (FANETs) that are formed by unmanned aerial vehicles (UAVs). GL can significantly enhance the efficiency and extend the battery life of UAV networks. Despite the advantages, the performance of GL is strongly affected by data distribution, communication speed, and network connectivity. However, how these factors influence the GL convergence is still unclear. Existing work studied the convergence of GL based on a virtual quantity for the sake of convenience, which failed to reflect the real state of the network when some nodes are inaccessible. In this paper, we formulate and investigate the impact of inaccessible nodes to GL under a dynamic network topology. We first decompose the weight divergence by whether the node is accessible or not. Then, we investigate the GL convergence under the dynamic of node accessibility and theoretically provide how the number of inaccessible nodes, data non-i.i.d.-ness, and duration of inaccessibility affect the convergence. Extensive experiments are carried out in practical settings to comprehensively verify the correctness of our theoretical findings. Copyright © 2024, The Authors. All rights reserved.

关键词： Antennas

来源：评论

学校读者我要写书评

暂无评论

Robust Beamforming Design and Antenna Selection for Dynamic HRIS-aided MISO systems

arXiv

引用

arXiv 2024年

作者： Wang, Jintao Zhou, Binggui Ma, Chengzhi Gong, Shiqi Yang, Guanghua Ma, Shaodan The State Key Laboratory of Internet of Things for Smart City The Department of Electrical and Computer Engineering University of Macau 999078 China The School of Cyberspace Science and Technology Beijing Institute of Technology Beijing100081 China The School of Intelligent Systems Science and Engineering Jinan University Zhuhai519070 China

In this paper, we propose a dynamic hybrid active-passive reconfigurable intelligent surface (HRIS) to enhance multiple-input-single-output (MISO) communications, leveraging the property of dynamically placing active elements. Specifically, considering the impact of hardware impairments (HWIs), we investigate channel-aware configurations of the receive antennas at the base station (BS) and the active/passive elements at the HRIS to improve transmission reliability. To this end, we address the average mean-square-error (MSE) minimization problem for the HRIS-aided MISO system by jointly optimizing the BS receive antenna selection matrix, the reflection phase coefficients, the reflection amplitude matrix, and the mode selection matrix of the HRIS. To overcome the non-convexity and intractability of this problem, we first transform the binary and discrete variables into continuous ones, and then propose a penalty-based exact block coordinate descent (PEBCD) algorithm to alternately solve these subproblems. Numerical simulations demonstrate the significant superiority of our proposed scheme over conventional benchmark schemes. Copyright © 2024, The Authors. All rights reserved.

关键词： Mean square error

来源：评论

学校读者我要写书评

暂无评论

MR2CPPIS: Accurate prediction of protein–protein interaction sites based on multi-scale Res2Net with coordinate attention mechanism

引用

computers in Biology and Medicine 2024年 176卷 108543-108543页

作者： Gong, Yinyin Li, Rui Liu, Yan Wang, Jilong Cao, Buwen Fu, Xiangzheng Li, Renfa Chen, Danny Z. College of Computer Science and Electronic Engineering Hunan University Changsha410082 China Hunan Engineering Research Center of Advanced Embedded Computing and Intelligent Medical Systems Hunan University Changsha410082 China Peng Cheng Laboratory Shenzhen518066 China College of Information and Electronic Engineering Hunan City University Yiyang413002 China Department of Computer Science and Engineering University of Notre Dame Notre DameIN46556 United States

Proteins play a vital role in various biological processes and achieve their functions through protein–protein interactions (PPIs). Thus, accurate identification of PPI sites is essential. Traditional biological methods for identifying PPIs are costly, labor-intensive, and time-consuming. The development of computational prediction methods for PPI sites offers promising alternatives. Most known deep learning (DL) methods employ layer-wise multi-scale CNNs to extract features from protein sequences. But, these methods usually neglect the spatial positions and hierarchical information embedded within protein sequences, which are actually crucial for PPI site prediction. In this paper, we propose MR2CPPIS, a novel sequence-based DL model that utilizes the multi-scale Res2Net with coordinate attention mechanism to exploit multi-scale features and enhance PPI site prediction capability. We leverage the multi-scale Res2Net to expand the receptive field for each network layer, thus capturing multi-scale information of protein sequences at a granular level. To further explore the local contextual features of each target residue, we employ a coordinate attention block to characterize the precise spatial position information, enabling the network to effectively extract long-range dependencies. We evaluate our MR2CPPIS on three public benchmark datasets (Dset 72, Dset 186, and PDBset 164), achieving state-of-the-art performance. The source codes are available at https://***/YyinGong/MR2CPPIS. © 2024 Elsevier Ltd

关键词： Forecasting

来源：评论

学校读者我要写书评

暂无评论

Look Inside for More: Internal Spatial Modality Perception for 3D Anomaly Detection 39

Look Inside for More: Internal Spatial Modality Perception f...

引用

39th Annual AAAI Conference on Artificial Intelligence, AAAI 2025

作者： Liang, Hanzhe Xie, Guoyang Hou, Chengbin Wang, Bingshu Gao, Can Wang, Jinbao College of Computer Science and Software Engineering Shenzhen University Shenzhen China Shenzhen Audencia Financial Technology Institute Shenzhen University Shenzhen China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Shenzhen China Department of Intelligent Manufacturing CATL Ningde China School of Computing and Artificial Intelligence Fuyao University of Science and Technology Fuzhou China School of Software Northwestern Polytechnical University Xi’an China Guangdong Provincial Key Laboratory of Intelligent Information Processing Shenzhen China

ISBN: (纸本)157735897X

3D anomaly detection has recently become a significant focus in computer vision. Several advanced methods have achieved satisfying anomaly detection performance. However, they typically concentrate on the external structure of 3D samples and struggle to leverage the internal information embedded within samples. Inspired by the basic intuition of why not look inside for more, we introduce a straightforward method named Internal Spatial Modality Perception (ISMP) to explore the feature representation from internal views fully. Specifically, our proposed ISMP consists of a critical perception module, Spatial Insight Engine (SIE), which abstracts complex internal information of point clouds into essential global features. Besides, to better align structural information with point data, we propose an enhanced key point feature extraction module for amplifying spatial structure feature representation. Simultaneously, a novel feature filtering module is incorporated to reduce noise and redundant features for further aligning precise spatial structure. Extensive experiments validate the effectiveness of our proposed method, achieving object-level and pixel-level AUROC improvements of 4.2% and 13.1%, respectively, on the Real3D-AD benchmarks. Note that the strong generalization ability of SIE has been theoretically proven and is verified in both classification and segmentation tasks. © 2025, Association for the Advancement of Artificial Intelligence (***). All rights reserved.

关键词： Feature extraction

来源：评论

学校读者我要写书评

暂无评论

GLoT: A Novel Gated-Logarithmic Transformer for Efficient Sign Language Translation

GLoT: A Novel Gated-Logarithmic Transformer for Efficient Si...

引用

IEEE Future Networks World Forum (FNWF)

作者： Nada Shahin Leila Ismail Department of Computer Science and Software Engineering Intelligent Distributed Computing and Systems (INDUCE) Lab College of Information Technology UAE University Al-Ain United Arab Emirates Emirates Center for Mobility Research UAE University Al-Ain United Arab Emirates

ISBN: (数字)9798350379495

ISBN: (纸本)9798350379501

Machine Translation has played a critical role in reducing language barriers, but its adaptation for Sign Language Machine Translation (SLMT) has been less explored. Existing works on SLMT mostly use the Transformer neural network which exhibits low performance due to the dynamic nature of the sign language. In this paper, we propose a novel Gated-Logarithmic Transformer (GLoT) that captures the long-term temporal dependencies of the sign language as a time-series data. We perform a comprehensive evaluation of GloT with the transformer and transformer-fusion models as a baseline, for Sign-to-Gloss-to-Text translation. Our results demonstrate that GLoT consistently outperforms the other models across all metrics. These findings underscore its potential to address the communication challenges faced by the Deaf and Hard of Hearing community.

关键词： Sign language Adaptation models Translation Accuracy Terminology Neural networks Semantics Logic gates Transformers Testing

来源：评论

学校读者我要写书评

暂无评论

OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios

arXiv

引用

arXiv 2024年

作者： Yuan, Ziqi Zhang, Baozheng Xu, Hua Liang, Zhiyun Gao, Kai State Key Laboratory of Intelligent Technology and Systems Department of Computer Science and Technology Tsinghua University China China School of Information Science and Engineering Hebei University of Science and Technology China College of Information and Electrical Engineering China Agricultural University China Technology Development Co. Ltd. China

We present OpenVNA, an open-source framework designed for analyzing the behavior of multimodal language understanding systems under noisy conditions. OpenVNA serves as an intuitive toolkit tailored for researchers, facilitating convenience batch-level robustness evaluation and on-the-fly instance-level demonstration. It primarily features a benchmark Python library for assessing global model robustness, offering high flexibility and extensibility, thereby enabling customization with user-defined noise types and models. Additionally, a GUI-based interface has been developed to intuitively analyze local model behavior. In this paper, we delineate the design principles and utilization of the created library and GUI-based web platform. Currently, OpenVNA is publicly accessible at https://***/thuiar/OpenVNA, with a demonstration video available at https://***/0Z9cW7RGct4. © 2024, CC BY-NC-SA.

关键词： Graphical user interfaces

来源：评论

学校读者我要写书评

暂无评论

Amplifying the Music Listening Experience through Song Comments on Music Streaming Platforms

arXiv

引用

arXiv 2023年

作者： Chen, Longfei Liu, Qianyu Zhang, Chenyang Huang, Yangkun Peng, Zhenhui Zeng, Haipeng Sun, Zhida Ma, Xiaojuan Li, Quan The School of Information Science and Technology ShanghaiTech University Shanghai Engineering Research Center of Intelligent Vision and Imaging China The Department of Computer Science University of Illinois Urbana-Champaign United States Tandon School of Engineering New York University United States The School of Artificial Intelligence Sun Yat-Sen University China The School of Intelligent Systems Engineering Sun Yat-Sen University China The College of Computer Science and Software Engineering Shenzhen University China The Department of Computer Science and Engineering The Hong Kong University of Science and Technology Hong Kong

Music streaming services are increasingly popular among younger generations who seek social experiences through personal expression and sharing of subjective feelings in comments. However, such emotional aspects are often ignored by current platforms, which affects the listeners' ability to find music that triggers specific personal feelings. To address this gap, this study proposes a novel approach that leverages deep learning methods to capture contextual keywords, sentiments, and induced mechanisms from song comments. The study augments a current music app with two features, including the presentation of tags that best represent song comments and a novel map metaphor that reorganizes song comments based on chronological order, content, and sentiment. The effectiveness of the proposed approach is validated through a usage scenario and a user study that demonstrate its capability to improve the user experience of exploring songs and browsing comments of interest. This study contributes to the advancement of music streaming services by providing a more personalized and emotionally rich music experience for younger generations. © 2023, CC BY.

关键词： Music

来源：评论

学校读者我要写书评

暂无评论

HealthEdge: A Machine Learning-Based Smart Healthcare Framework for Prediction of Type 2 Diabetes in an Integrated IoT, Edge, and Cloud Computing System

引用

Procedia computer science 2023年 220卷 331-338页

作者： Alain Hennebelle Huned Materwala Leila Ismail Independent Researcher Melbourne Australia Intelligent Distributed Computing and Systems (INDUCE) Research Laboratory Department of Computer Science and Software Engineering College of Information Technology United Arab Emirates University United Arab Emirates National Water and Energy Center United Arab Emirates University United Arab Emirates Cloud Computing and Distributed Systems (CLOUDS) Lab School of Computing and Information Systems The University of Melbourne Australia

Diabetes Mellitus has no permanent cure to date and is one of the leading causes of death globally. The alarming increase in diabetes calls for the need to take precautionary measures to avoid/predict the occurrence of diabetes. This paper proposes HealthEdge, a machine learning-based smart healthcare framework for type 2 diabetes prediction in an integrated IoT-edge-cloud computing system. Numerical experiments and comparative analysis were carried out between the two most used machine learning algorithms in the literature, Random Forest (RF) and Logistic Regression (LR), using two real-life diabetes datasets. The results show that RF predicts diabetes with 6% more accuracy on average compared to LR.

关键词： Artificial Intelligence (AI) Cloud Computing Diagnosis Digital Health Edge Computing eHealth Internet of Things (IoT) Logisitic Regression Machine Learning Prognosis Random Forest Risk Factors Smart Connected Healthcare Type 2 Diabetes Mellitus

来源：评论

学校读者我要写书评

暂无评论

Uncertainty Quantification and Quality Control for Heatmap-based Landmark Detection Models

引用

IEEE Transactions on Medical Imaging 2025年

作者： Feng, Yong Yang, Jinzhu Tang, Lingzhi Sun, Song Wang, Yonghuai Northeastern University Key Laboratory of Intelligent Computing in Medical Image Ministry of Education Shenyang China Northeastern University School of Computer Science and Engineering Shenyang China National Frontiers Science Center for Industrial Intelligence and Systems Optimization Shenyang China The First Hospital of China Medical University Department of Cardiovascular Ultrasound Shenyang China

Uncertainty quantification is a vital aspect of explainable artificial intelligence that fosters clinician trust in medical applications and facilitates timely interventions, leading to safer and more reliable outcomes. Although deep learning models have reached clinically acceptable accuracy in anatomical landmark detection, their predictions remain susceptible to contextual noise due to the small size of the target structures, making uncertainty quantification more challenging than in classification and segmentation tasks. This paper presents an end-to-end uncertainty quantification method tailored for heatmapbased anatomical landmark detection models, designed to improve both interpretability and controllability in clinical applications. Leveraging Dempster-Shafer Theory and Subjective Logic Theory, we implement probability assignment and uncertainty quantification through a single forward pass to ensure computational efficiency. We introduce an evidence map that captures the strength of landmark evidence, alongside an uncertainty map that calibrates predicted probabilities within the Subjective Logic framework. The interaction between these two components, facilitated by a cross-attention mechanism, further improves landmark detection accuracy and enhances the effectiveness of uncertainty quantification. Experimental results demonstrate that the proposed method maintains detection accuracy, even in noisy environments, while outperforming state-of-the-art methods in terms of uncertainty quantification and quality control. Furthermore, the model effectively identifies out-of-distribution data solely through calibrated probabilities when encountering inconsistencies in multi-center data and novel data, underscoring its potential for clinical applications. © 1982-2012 IEEE.

关键词： Model predictive control

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：