检索结果-内蒙古大学图书馆

MLFuse: Multi-Scenario Feature Joint Learning for Multi-Modality Image Fusion

IEEE Transactions on Multimedia 2025年

作者： Lei, Jia Li, Jiawei Liu, Jinyuan Wang, Bin Zhou, Shihua Zhang, Qiang Wei, Xiaopeng Kasabov, Nikola K. Dalian University Key Laboratory of Advanced Design and Intelligent Computing Ministry of Education School of Software Engineering Dalian116622 China University of Science and Technology Beijing School of Computer and Communication Engineering Beijing100083 China Dalian University of Technology School of Mechanical Engineering Dalian116024 China Dalian University of Technology School of Computer Science and Technology Dalian116024 China Auckland University of Technology Knowledge Engineering and Discovery Research Institute Auckland1010 New Zealand Ulster University Intelligent Systems Research Center LondonderryBT52 1SA United Kingdom

Multi-modality image fusion (MMIF) entails synthesizing images with detailed textures and prominent objects. Existing methods tend to use general feature extraction to handle different fusion tasks. However, these methods have difficulty breaking fusion barriers across various modalities owing to the lack of targeted learning routes. In this work, we propose a multi-scenario feature joint learning architecture, MLFuse, that employs the commonalities of multi-modality images to deconstruct the fusion progress. Specifically, we construct a cross-modal knowledge reinforcing network that adopts a multipath calibration strategy to promote information communication between different images. In addition, two professional networks are developed to maintain the salient and textural information of fusion results. The spatial-spectral domain optimizing network can learn the vital relationship of the source image context with the help of spatial attention and spectral attention. The edge-guided learning network utilizes the convolution operations of various receptive fields to capture image texture information. The desired fusion results are obtained by aggregating the outputs from the three networks. Extensive experiments demonstrate the superiority of MLFuse for infrared-visible image fusion and medical image fusion. The excellent results of downstream tasks (i.e., object detection and semantic segmentation) further verify the high-quality fusion performance of our method. The code is publicly available at https://***/jialei-sc/MLFuse. © 1999-2012 IEEE.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

EFFICIENT 3D AFFINELY EQUIVARIANT CNNS WITH ADAPTIVE FUSION OF AUGMENTED SPHERICAL FOURIER-BESSEL BASES

arXiv

引用

arXiv 2024年

作者： Zhao, Wenzhao Albert, Steffen Wichtmann, Barbara D. Maurer, Angelika Attenberger, Ulrike Zöllner, Frank G. Hesser, Jürgen School of Information Engineering Nanjing University of Finance and Economics Interdisciplinary Center for Scientific Computing Mannheim Institute for Intelligent Systems in Medicine Medical Faculty Mannheim Heidelberg University Germany Computer Assisted Clinical Medicine Mannheim Institute for Intelligent Systems in Medicine Medical Faculty Mannheim Heidelberg University Germany Clinic of Neuroradiology University Hospital Bonn Germany Department of Diagnostic and Interventional Radiology University Hospital Bonn Germany Department of Biomedical Imaging and Image-guided Therapy Medical University of Vienna Austria Interdisciplinary Center for Scientific Computing Central Institute for Computer Engineering CSZ Heidelberg Center for Model-Based AI Data Analysis and Modeling in Medicine Mannheim Institute for Intelligent Systems in Medicine Medical Faculty Mannheim Heidelberg University Germany

Filter-decomposition-based group equivariant convolutional neural networks (CNNs) have shown promising stability and data efficiency for 3D image feature extraction. However, these networks, which rely on parameter sharing and discrete transformation groups, often underperform in modern deep neural network architectures for processing volumetric images, such as the common 3D medical images. To address these limitations, this paper presents an efficient non-parameter-sharing continuous 3D affine group equivariant neural network for volumetric images. This network uses an adaptive aggregation of Monte Carlo augmented spherical Fourier-Bessel filter bases to improve the efficiency and flexibility of 3D group equivariant CNNs for volumetric data. Unlike existing methods that focus only on angular orthogonality in filter bases, the introduced spherical Bessel Fourier filter base incorporates both angular and radial orthogonality to improve feature extraction. Experiments on four medical image segmentation datasets show that the proposed methods achieve better affine group equivariance and superior segmentation accuracy than existing 3D group equivariant convolutional neural network layers, significantly improving the training stability and data efficiency of conventional CNN layers (at 0.05 significance level). The code is available at https://***/ZhaoWenzhao/WMCSFB. Copyright © 2024, The Authors. All rights reserved.

关键词： Spheres

来源：评论

学校读者我要写书评

暂无评论

Improving Urban Canyons based on a Graph Transformer

引用

Navigation, Journal of the Institute of Navigation 2024年第4期71卷

作者： Zheng, Shaolong Zeng, Kungan Li, Zhenni Wang, Qianming Xie, Kan Liu, Ming Xie, Shengli School of Automation Guangdong University of Technology Guangzhou China Guangdong–HongKong–Macao Joint Laboratory for Smart Discrete Manufacturing Guangzhou China 111 Center for Intelligent Batch Manufacturing Based on Internet of Things Technology Guangzhou China Techtotop Microelectronics Technology Co. Ltd Guangzhou China Department of Electronic and Computer Engineering Hong Kong University of Science and Technology China Key Laboratory of Intelligent Detection and the Internet of Things in Manufacturing Guangzhou China Guangdong Provincial Key Laboratory of Intelligent Systems and Optimization Integration Guangzhou China

Signals from global navigation satellite systems (GNSSs) in urban areas suffer from serious multipath errors caused by building blockages and reflections. The use of deep neural networks offers great potential for predicting and eliminating com-plex multipath/non-line-of-sight (NLOS) errors. However, existing methods for predicting the original signals face two remaining challenges. The first challenge is an inability to effectively exploit irregular GNSS measurement data caused by an inconsistent number of visible satellites in different epochs. The second challenge is degradation in the generalization performance of the multipath/NLOS prediction model when using data collected from different locations and periods. To address these challenges, this paper proposes a novel graph transformer neural network (GTNN) for predicting satellite visibility that effectively learns environment representations from irregular GNSS measurements to both alleviate multipath interference and improve the generalization performance of the multipath prediction model. To learn from irregular GNSS measurements, a sky satellite graph is constructed as input to a graph neural network by using satellites captured in the same epoch, which can represent the spatial relationships between satellites and enable the model to learn satellite-related features sufficiently well. To improve the generalization ability of our multipath prediction model, a multihead attention mechanism is introduced to aggregate satellite node information by computing the correlation between satellites to extract the environment representation around the receiver. based on the constructed sky satellite graph and the multihead attention mechanism, our novel GTNN for predicting satellite visibility can not only handle irregular GNSS measurements but can also learn an environment representation via graph attention. Comparative experiments were conducted on real-world GNSS measurement data in urban areas, demonstrating that

关键词： Graph neural networks

来源：评论

学校读者我要写书评

暂无评论

从信号到知识——基于人工智能的医学影像裸数据诊断价值初探

引用

engineering 2024年第3期34卷 60-69页

作者： Bingxi He Yu Guo Yongbei Zhu Lixia Tong Boyu Kong Kun Wang Caixia Sun Hailin Li Feng Huang Liwei Wu Meng Wang Fanyang Meng Le Dou Kai Sun Tong Tong Zhenyu Liu Ziqi Wei Wei Mu Shuo Wang Zhenchao Tang Shuaitong Zhang Jingwei Wei Lizhi Shao Mengjie Fang Juntao Li Shouping Zhu Lili Zhou Shuo Wang Di Dong Huimao Zhang Jie Tian Beijing Advanced Innovation Center for Big Data-Based Precision Medicine School of Engineering MedicineBeihang UniversityBeijing 100191China Key Laboratory of Big Data-Based Precision Medicine Beihang UniversityMinistry of Industry and Information TechnologyBeijing 100191China CAS Key Laboratory of Molecular Imaging Institute of AutomationChinese Academy of SciencesBeijing 100190China Department of Radiology The First Hospital of Jilin UniversityChangchun 130021China Neusoft Medical Systems Co.Ltd. Shenyang 110167China Neusoft Research of Intelligent Healthcare Technology Co.Ltd. Shenyang 110167China School of Life Science and Technology Xidian UniversityXi’an 710126China Engineering Research Center of Molecular and Neuro Imaging Ministry of EducationXi’an 710126China School of Artificial Intelligence University of Chinese Academy of SciencesBeijing 100049China

Encouraging and astonishing developments have recently been achieved in image-based diagnostic *** medical care and imaging technology are becoming increasingly ***,the current diagnosis pattern of signal to image to knowledge inevitably leads to information distortion and noise introduction in the procedure of image reconstruction(from signal to image).Artificial intelligence(AI)technologies that can mine knowledge from vast amounts of data offer opportunities to disrupt established *** this prospective study,for the first time,we develop an AI-based signal-toknowledge diagnostic scheme for lung nodule classification directly from the computed tomography(CT)raw data(the signal).We find that the raw data achieves almost comparable performance with CT,indicating that it is possible to diagnose diseases without reconstructing ***,the incorporation of raw data through three common convolutional network structures greatly improves the performance of the CT models in all cohorts(with a gain ranging from 0.01 to 0.12),demonstrating that raw data contains diagnostic information that CT does not *** results break new ground and demonstrate the potential for direct signal-to-knowledge domain analysis.

关键词： Computed tomography Diagnosis Deep learning Lung cancer Raw data

来源：评论

学校读者我要写书评

暂无评论

Human-Centric Concept for a Reconfigurable Robotic System Enabling Low-Volume Assembly of Photonic and Quantum Modules

Human-Centric Concept for a Reconfigurable Robotic System En...

引用

IEEE/SICE International Symposium on System Integration

作者： Andreas Wicht Tobias Franke Alina Hahn Nils Håkansson Christian Kürbis Robert Smol Thomas Hulin Thomas Eiband Peter Lehner Maximilian Mühlbauer Korbinian Nottensteiner Richard Pietschmann Bernhard Thaler Diana Thaler Jürgen Bosse Ferdinand-Braun-Institut (FBH) Berlin Germany Institute of Robotics and Mechatronics German Aerospace Center (DLR) Wessling Germany Centre for Tactile Internet with Human-in-the-Loop (CeTI) Germany Sensor Based Robotic Systems and Intelligent Assistance Systems Technical University of Munich Garching Germany Robo-Technology GmbH Puchheim Germany Thaler Engineering GmbH Eichenau Germany Coherent Munich GmbH & Co. KG Gilching Germany

ISBN: (数字)9798331531614

ISBN: (纸本)9798331531621

This paper presents a novel concept for a reconfigurable robotic system specifically designed to meet the demands of hybrid integration for miniaturized photonic and quantum System-in-Packages (SiPs). The proposed solution introduces a distinctive approach to ultra-high-resolution, multi-telerobotic assembly and inspection. By integrating key Industry 5.0 principles, it establishes a human-centric control framework that minimizes both physical and cognitive stress while ensuring the human operator remains in full control at all *** robotic system features eight robots working simultaneously within a compact footprint of just 5×10 cm 2 . A comprehensive digital twin framework constitutes a central element of the robotic system. It encompasses the robotic workcell, the SiP under assembly, and the components to be integrated, ensuring precise adherence to design specifications. Key functionalities include automated path planning in a multi-robotic environment, collision avoidance in a densely packed workcell, and virtual fixtures to guide teleoperation, enhancing the operator’s control and interaction through advanced and intuitive human-machine interfaces (HMI). The proposed system meets the critical demands of ultra-high-resolution assembly for complex, high-value SiPs, providing high flexibility and ease of operation for small-batch manufacturing.

关键词： System-in-package Service robots Robot kinematics Fixtures System integration Digital twins Collision avoidance Fifth Industrial Revolution Assembly Photonics

来源：评论

学校读者我要写书评

暂无评论

Composing complex and hybrid AI solutions

arXiv

引用

arXiv 2022年

作者： Schüller, Peter Costeira, João Paulo Crowley, James Grosinger, Jasmin Ingrand, Félix Köckemann, Uwe Saffotti, Alessandro Welss, Martin Knowledge-based Systems Group Technische Universität Wien Vienna Austria Institute for Systems and Robotics Técnico Lisboa Lisbon Portugal Univ. Grenoble Alpes CNRS Inria Grenoble France Center for Applied Autonomous Sensor Systems Örebro University Sweden LAAS-CNRS University of Toulouse France Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS Germany

Progress in several areas of computer science has been enabled by comfortable and efficient means of experimentation, clear interfaces, and interchangable components, for example using OpenCV for computer vision or ROS for robotics. We describe an extension of the Acumos system towards enabling the above features for general AI applications. Originally, Acumos was created for telecommunication purposes, mainly for creating linear pipelines of machine learning components. Our extensions include support for more generic components with gRPC/Protobuf interfaces, automatic orchestration of graphically assembled solutions including control loops, sub-component topologies, and event-based communication, and provisions for assembling solutions which contain user interfaces and shared storage areas. We provide examples of deployable solutions and their interfaces. The framework is deployed at http://***/ and its source code is managed as an open source Eclipse project. © 2022, CC BY.

关键词： User interfaces

来源：评论

学校读者我要写书评

暂无评论

ViGT: Proposal-free Video Grounding with Learnable Token in Transformer

arXiv

引用

arXiv 2023年

作者： Li, Kun Guo, Dan Wang, Meng School of Computer Science and Information Engineering Hefei University of Technology Hefei230601 China Key Laboratory of Knowledge Engineering with Big Data Ministry of Education Hefei230601 China Intelligent Interconnected Systems Laboratory of Anhui Province Hefei230601 China Institute of Artificial Intelligence Hefei Comprehensive National Science Center Hefei230088 China

The video grounding (VG) task aims to locate the queried action or event in an untrimmed video based on rich linguistic descriptions. Existing proposal-free methods are trapped in complex interaction between video and query, overemphasizing cross-modal feature fusion and feature correlation for VG. In this paper, we propose a novel boundary regression paradigm that performs regression token learning in a transformer. Particularly, we present a simple but effective proposal-free framework, namely Video Grounding Transformer (ViGT), which predicts the temporal boundary using a learnable regression token rather than multi-modal or cross-modal features. In ViGT, the benefits of a learnable token are manifested as follows. (1) The token is unrelated to the video or the query and avoids data bias toward the original video and query. (2) The token simultaneously performs global context aggregation from video and query features. First, we employed a sharing feature encoder to project both video and query into a joint feature space before performing cross-modal co-attention (i.e., video-to-query attention and query-to-video attention) to highlight discriminative features in each modality. Furthermore, we concatenated a learnable regression token [REG] with the video and query features as the input of a vision-language transformer. Finally, we utilized the token [REG] to predict the target moment and visual features to constrain the foreground and background probabilities at each timestamp. The proposed ViGT performed well on three public datasets: ANet Captions, TACoS and YouCookII. Extensive ablation studies and qualitative analysis further validated the interpretability of ViGT. Copyright © 2023, The Authors. All rights reserved.

关键词： Regression analysis

来源：评论

学校读者我要写书评

暂无评论

Efficient Graph Neural Network Driven Recurrent Reinforcement Learning for GNSS Position Correction 36

Efficient Graph Neural Network Driven Recurrent Reinforcemen...

引用

36th International Technical Meeting of the Satellite Division of the Institute of Navigation, ION GNSS+ 2023

作者： Zhao, Haoli Tang, Jianhao Li, Zhenni Wu, Zhuoyu Xie, Shengli Wu, Zhaofeng Liu, Ming Kumara, Banage T.G.S. School of Automation Guangdong University of Technology Guangzhou510006 China Guangdong-HongKong-Macao Joint Laboratory for Smart Discrete Manufacturing Guangzhou510006 China 111 Center for Intelligent Batch Manufacturing Based on IoT Technology Guangzhou510006 China Key Laboratory of Intelligent Detection and The Internet of Things in Manufacturing Guangzhou510006 China Guangdong Key Laboratory of IoT Information Technology Guangzhou510006 China Techtotop Microelectronics Technology Co. Ltd. Guangzhou510000 China Department of Electronic and Computer Engineering Hong Kong University of Science and Technology Hong Kong Department of Computing and Information Systems Sabaragamuwa University of Sri Lanka Belihuloya Sri Lanka

ISBN: (纸本)9780936406350

With the wide applications of the Global Navigation Satellite System (GNSS) in autonomous driving scenarios, the demand for high-precision positioning of navigation systems has increased dramatically in complex multipath environments. Conventional model-based methods are constrained by strict assumptions about noise models and can hardly model complex environment errors. In contrast, approaches based on artificial intelligent learning have become an important direction to solving the problem of high-precision positioning because learning-based approaches only require simple assumptions. However, current learning-based approaches are facing the following issues. The existing Graph Neural Network-based (GNN) method could hardly adapt to dynamically changing driving environment scenarios since it considers positioning discretely. On the other hand, existing Reinforcement Learning-based (RL) approaches ignore the relationship between multi-constellation satellites, resulting in an inadequate description of the driving correction environment observations. In this paper, we construct a GNN-driven recurrent reinforcement learning method to consider the GNSS measurement of multi-constellation satellites and to learn real-time correction strategy in the dynamic driving environment. To establish a comprehensive positioning correction environment, we construct a multi-constellation graph observation, based on the feature vector concerning GNSS measurement of multi-constellation satellites and edges for satellites in and between constellations. To make more effective use of GNSS measurements, we employ the graph embedding module to deal with the multi-constellation graph inputs, to extract hidden topological features to form the brief states about relationships between multi-constellation satellites for the RL environment. Finally, we construct a recurrent actor-critic structured RL model with cumulative reward and continuous action space to exploit historical information and a

关键词：

来源：评论

学校读者我要写书评

暂无评论

Implicit smoothed particle hydrodynamics model for simulating incompressible fluid-elastic coupling

Implicit smoothed particle hydrodynamics model for simulatin...

引用

作者： Wang, Xiaokun Wang, Tiancheng Wang, Jiamin Xu, Yanrui Ban, Xiaojuan Huang, Houbin Zhu, Zhihong Chang, Jian Zhang, Jian Jun School of Intelligence Science and Technology University of Science and Technology Beijing Beijing China Beijing Key Laboratory of Knowledge Engineering for Materials Science University of Science and Technology Beijing Beijing China National Centre for Computer Animation Bournemouth University Poole United Kingdom Beijing Advanced Innovation Center for Materials Genome Engineering University of Science and Technology Beijing Beijing China Key Laboratory of Perception and Control of Intelligent Bionic Unmanned Systems Ministry of Education University of Science and Technology Beijing Beijing China Chinese PLA General Hospital Beijing China Hainan Hospital of Chinese PLA General Hospital Hainan Sanya China

Fluid simulation has been one of the most critical topics in computer graphics for its capacity to produce visually realistic effects. The intricacy of fluid simulation manifests most with interacting dynamic elements. The coupling for such scenarios has always been challenging to manage due to the numerical instability arising from the coupling boundary between different elements. Therefore, we propose an implicit smoothed particle hydrodynamics fluid-elastic coupling approach to reduce the instability issue for fluid-fluid, fluid-elastic, and elastic-elastic coupling circumstances. By deriving the relationship between the universal pressure field with the incompressible attribute of the fluid, we apply the number density scheme to solve the pressure Poisson equation for both fluid and elastic material to avoid the density error for multi-material coupling and conserve the non-penetration condition for elastic objects interacting with fluid particles. Experiments show that our method can effectively handle the multiphase fluids simulation with elastic objects under various physical properties. © 2023 The Authors. Computer Animation and Virtual Worlds published by John Wiley & Sons Ltd.

关键词： Poisson equation

来源：评论

学校读者我要写书评

暂无评论

MFE-Net: A Novel Multi-scale Feature Enhancement Network for SAR Ship Instance Segmentation

引用

IEEE Geoscience and Remote Sensing Letters 2025年

作者： Liu, Li Zhang, Shuo Hu, Mingtao North China Electric Power University Hebei Key Laboratory of Knowledge Computing for Energy and Power Department of Computer Baoding071000 China Ministry of Education Engineering Research Center of Intelligent Computing for Complex Energy Systems Department of Computer North China Electric Power University Baoding071000 China University of Chinese Academy of Sciences Aerospace Information Research Institute Chinese Academy of Sciences Beijing100190 China

Deep learning has achieved significant progress in ship instance segmentation for synthetic aperture radar (SAR) im-ages. However, due to the challenges posed by inshore scenes, such as dense clustering, arbitrary arrangement orientation, and multi-scale targets, the performance of existing methods still falls short of expectations. To overcome the dilemma, we propose MFE-Net, a one-stage instance segmentation network based on oriented bounding box (OBB). First, we design an Orientation-aware Seg-mentation Head (OSeg Head) to enhance the network's perception of directional features while mitigating interference from complex background. Additionally, a Feature Aggregation Diffusion Pyra-mid (FADP) is proposed, consisting of the Multi-level Feature Alignment Module (MAM) and the Multi-scale Feature Enhance-ment Module (MFEM). The FADP aggregates global semantic and detailed information, and effectively enhances the feature repre-sentations of both deep and shallow layers through multi-scale fea-ture extraction. Experimental results on two public benchmark datasets (HRSID, SSDD) and a self-built dataset (HRSID_IS) demonstrate that MFE-Net achieves an ideal trade-off between ac-curacy and efficiency, respectively reaching 58.9%, 63.0%, and 46.9% AP with parameters of 12.36M. © 2004-2012 IEEE.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：