检索结果-内蒙古大学图书馆

Multiview Integration Network for Multitask robotic Surgical Scene Analysis

IEEE Transactions on Instrumentation and Measurement 2025年 74卷

作者： Shen, Wenting Wang, Yaonan Liu, Min Wang, Jiazheng Ding, Renjie Zhang, Zhe Meijering, Erik Hunan University College of Electrical and Information Engineering National Engineering Research Center of Robot Visual Perception and Control Technology International Scientific and Technological Innovation Cooperation Base for Biomedical Image Processing Hunan Changsha410082 China University of New South Wales School of Computer Science and Engineering SydneyNSW2052 Australia

Surgical scene analysis holds a pivotal role in robot-assisted surgery. However, existing methods often suffer from single or little views, leading to erroneous scene analysis conclusions. To address these issues, a novel Multiview Integration Network (MVINet) is proposed, which comprehensively analyzes the surgical scene by integrating effective information from multiple views, including global, local, dynamic, and static views. As a multitask scene analysis network, MVINet could simultaneously perform semantic segmentation of surgical instruments and detection of instrument-tissue interaction. By designing a unique Global-Local Spatial Feature Memory module (G-LSFM), the joint information from globally and locally analyzed views following graph analysis simultaneously enhances the accuracy of multitask scene analysis. The Dynamic-Static visual Feature Memory module (D-SVFM) introduces an innovative approach by simultaneously incorporating temporal feature from consecutive frames and static feature from single frame into the node features of the interaction reasoning network. The multiscale perspective of both features further enhances the ability of the module to analyze the complex scenes. Experimental results on a public and a private dataset demonstrate that our method achieves superior performance compared to other state-of-the-art methods for two crucial tasks in surgical scene analysis. In the instrument segmentation task, MVINet outperforms the second-best method by 1.73% and 0.55% in terms of mIoU scores. For the interaction detection task, MVINet surpasses the second-best method by 10.14% and 5.47% in mAP scores. © 1963-2012 IEEE.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

OAFuser: Towards Omni-Aperture Fusion for Light Field Semantic Segmentation

arXiv

引用

arXiv 2023年

作者： Teng, Fei Zhang, Jiaming Peng, Kunyu Wang, Yaonan Stiefelhagen, Rainer Yang, Kailun The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China The Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Karlsruhe76131 Germany The Institute for Visual Computing ETH Zurich Zurich8092 Switzerland

Light field cameras are capable of capturing intricate angular and spatial details. This allows for acquiring complex light patterns and details from multiple angles, significantly enhancing the precision of image semantic segmentation. However, two significant issues arise: (1) The extensive angular information of light field cameras contains a large amount of redundant data, which is overwhelming for the limited hardware resources of intelligent agents. (2) A relative displacement difference exists in the data collected by different micro-lenses. To address these issues, we propose an Omni-Aperture Fusion model (OAFuser) that leverages dense context from the central view and extracts the angular information from sub-aperture images to generate semantically consistent results. To simultaneously streamline the redundant information from the light field cameras and avoid feature loss during network propagation, we present a simple yet very effective Sub-Aperture Fusion Module (SAFM). This module efficiently embeds sub-aperture images in angular features, allowing the network to process each sub-aperture image with a minimal computational demand of only (∼1GFlops). Furthermore, to address the mismatched spatial information across viewpoints, we present a Center Angular Rectification Module (CARM) to realize feature resorting and prevent feature occlusion caused by misalignment. The proposed OAFuser achieves state-of-the-art performance on four UrbanLF datasets in terms of all evaluation metrics and sets a new record of 84.93% in mIoU on the UrbanLF-Real Extended dataset, with a gain of +3.69%. The source code for OAFuser is available at https://***/FeiBryantkit/OAFuser. Impact Statement-To solve the data abundance problem, we have reduced the significant computational consumption of light field cameras while not introducing any additional parameters. The proposed method has practical value for the deployment and application of light field cameras. The proposed

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

PanoVpr: Towards Unified Perspective-to-Equirectangular visual Place Recognition via Sliding Windows Across the Panoramic View

PanoVpr: Towards Unified Perspective-to-Equirectangular Visu...

引用

International Conference on Intelligent Transportation

作者： Ze Shi Hao Shi Kailun Yang Zhe Yin Yining Lin Kaiwei Wang State Key Laboratory of Modern Optical Instrumentation Zhejiang University Hangzhou China Shanghai SUPREMIND Technology Co. Ltd Shanghai China National Engineering Research Center of Robot Visual Perception and Control Technology School of Robotics Hunan University Changsha China

visual place recognition has gained significant attention in recent years as a crucial technology in autonomous driving and robotics. Currently, the two main approaches are the perspective view retrieval (P2P) paradigm and the equirectangular image retrieval (E2E) paradigm. However, it is practical and natural to assume that users only have consumer-grade pinhole cameras to obtain query perspective images and retrieve them in panoramic database images from map providers. To address this, we propose PanoVPR, a perspective-to-equirectangular (P2E) visual place recognition framework that employs sliding windows to eliminate feature truncation caused by hard cropping. Specifically, PanoVPR slides windows over the entire equirectangular image and computes feature descriptors for each window, which are then compared to determine place similarity. Notably, our unified framework enables direct transfer of the backbone from P2P methods without any modification, supporting not only CNNs but also Transformers. To facilitate training and evaluation, we derive the Pitts250k-P2E dataset from the Pitts250k and establish YQ360, latter is the first P2E visual place recognition dataset collected by a mobile robot platform aiming to simulate real-world task scenarios better. Extensive experiments demonstrate that PanoVPR achieves state-of-the-art performance and obtains 3.8% and 8.0% performance gain on Pitts250k-P2E and YQ360 compared to the previous best method, respectively. Code and datasets will be publicly available at PanoVPR.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Large Scale Unsupervised Brain MRI Image Registration Solution for Learn2Reg 2024

arXiv

引用

arXiv 2024年

作者： Zhang, Yuxi Chen, Xiang Wang, Jiazheng Liu, Min Wang, Yaonan Liu, Dongdong Hu, Renjiu Zhang, Hang College of Electrical and Information Engineering Hunan University Hunan Changsha China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Hunan Changsha China New York University New York United States Cornell University New York United States

In this paper, we summarize the methods and experimental results we proposed for Task 2 in the learn2reg 2024 Challenge. This task focuses on unsupervised registration of anatomical structures in brain MRI images between different patients. The difficulty lies in: (1) without segmentation labels, and (2) a large amount of data. To address these challenges, we built an efficient backbone network and explored several schemes to further enhance registration accuracy. Under the guidance of the NCC loss function and smoothness regularization loss function, we obtained a smooth and reasonable deformation field. According to the leaderboard, our method achieved a Dice coefficient of 77.34%, which is 1.4% higher than the TransMorph. Overall, we won second place on the leaderboard for Task 2. Copyright © 2024, The Authors. All rights reserved.

关键词： Image registration

来源：评论

学校读者我要写书评

暂无评论

Resilient Formation control Based on Watermarks for Networked Quadrotors under Deception Attacks

引用

IEEE Transactions on Vehicular Technology 2025年

作者： Zhan, Weiwei Miao, Zhiqiang Zeng, Jianxin Chen, Yanjie Wu, Zheng-Guang He, Wei Wang, Yaonan Hunan University College of Electrical and Information Engineering Changsha410082 China Fuzhou University School of Mechanical Engineering and Automation Fuzhou350108 China National Engineering Research Center of Robot Visual Perception and Control Technology Changsha410082 China Zhejiang University Institute of Cyber-Systems and Control Hangzhou310027 China University of Science and Technology Beijing Key Laboratory of Intelligent Bionic Unmanned Systems Ministry of Education School of Intelligence Science and Technology Institute of Artificial Intelligence Beijing100083 China

This article addresses the problem of formation control of networked UAVs under deception attacks. A lightweight resilient formation control framework based on watermarks is proposed to achieve the desired formation configuration without extra monitoring attack status. Since deception attacks are covert, the shared information is watermarked before transmission to establish the protocol among networked UAVs. To facilitate the resilient formation controller design, a decoder is first developed to decipher the inverse transformation of deception attacks, where the watermark is the criterion for approximating the inverse transformation. The Gauss error function is introduced to eliminate some unrealistic input commands under deception attacks, obtaining the predefined input performance. Then, a resilient formation controller is developed to guarantee the global boundedness of all signals within the inner-loop and outerloop system, while the formation error converges to a small neighborhood of zero by solving the linear matrix inequality. Two challenging deception attack examples in simulations and experiments are conducted to verify the effectiveness and performance of the proposed resilient formation control framework. © 1967-2012 IEEE.

关键词： Inverse transforms

来源：评论

学校读者我要写书评

暂无评论

Towards Consistent Object Detection via LiDAR-Camera Synergy

arXiv

引用

arXiv 2024年

作者： Luo, Kai Wu, Hao Yi, Kefu Yang, Kailun Hao, Wei Hu, Rongdong School of Traffic and Transportation Engineering Changsha University of Science and Technology China College of Automotive and Mechanical Engineering Changsha University of Science and Technology China School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China Changsha Intelligent Driving Institute China

As human-machine interaction continues to evolve, the capacity for environmental perception is becoming increasingly crucial. Integrating the two most common types of sensory data, images, and point clouds, can enhance detection accuracy. Currently, there is no existing model capable of detecting an object’s position in both point clouds and images while also determining their corresponding relationship. This information is invaluable for human-machine interactions, offering new possibilities for their enhancement. In light of this, this paper introduces an end-to-end Consistency Object Detection (COD) algorithm framework that requires only a single forward inference to simultaneously obtain an object’s position in both point clouds and images and establish their correlation. Furthermore, to assess the accuracy of the object correlation between point clouds and images, this paper proposes a new evaluation metric, Consistency Precision (CP). To verify the effectiveness of the proposed framework, an extensive set of experiments has been conducted on the KITTI and DAIR-V2X datasets. The study also explored how the proposed consistency detection method performs on images when the calibration parameters between images and point clouds are disturbed, compared to existing post-processing methods. The experimental results demonstrate that the proposed method exhibits excellent detection performance and robustness, achieving end-to-end consistency detection. The source code will be made publicly available at https://***/xifen523/COD. Copyright © 2024, The Authors. All rights reserved.

关键词： Image enhancement

来源：评论

学校读者我要写书评

暂无评论

Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimation

引用

IEEE Transactions on Pattern Analysis and Machine Intelligence 2025年第7期47卷 5520-5537页

作者： Jian Liu Wei Sun Hui Yang Pengchao Deng Chongpei Liu Nicu Sebe Hossein Rahmani Ajmal Mian National Engineering Research Center for Robot Visual Perception and Control Technology College of Electrical and Information Engineering School of Robotics and the State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body Hunan University Changsha China Institute of Artificial Intelligence and Robotics Xi’an Jiaotong University Xi’an China Department of Information Engineering and Computer Science University of Trento Trento Italy School of Computing and Communications Lancaster University Lancaster U.K. Department of Computer Science The University of Western Australia Crawley WA Australia

Nine-degrees-of-freedom (9-DoF) object pose and size estimation is crucial for enabling augmented reality and robotic manipulation. Category-level methods have received extensive research attention due to their potential for generalization to intra-class unknown objects. However, these methods require manual collection and labeling of large-scale real-world training data. To address this problem, we introduce a diffusion-based paradigm for domain-generalized category-level 9-DoF object pose estimation. Our motivation is to leverage the latent generalization ability of the diffusion model to address the domain generalization challenge in object pose estimation. This entails training the model exclusively on rendered synthetic data to achieve generalization to real-world scenes. We propose an effective diffusion model to redefine 9-DoF object pose estimation from a generative perspective. Our model does not require any 3D shape priors during training or inference. By employing the Denoising Diffusion Implicit Model, we demonstrate that the reverse diffusion process can be executed in as few as 3 steps, achieving near real-time performance. Finally, we design a robotic grasping system comprising both hardware and software components. Through comprehensive experiments on two benchmark datasets and the real-world robotic system, we show that our method achieves state-of-the-art domain generalization performance.

关键词： Shape Solid modeling Three-dimensional displays Pose estimation Training robots Grasping Diffusion models Real-time systems Point cloud compression

来源：评论

学校读者我要写书评

暂无评论

Towards Consistent Object Detection via LiDAR-Camera Synergy

Towards Consistent Object Detection via LiDAR-Camera Synergy

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Kai Luo Hao Wu Kefu Yi Kailun Yang Wei Hao Rongdong Hu College of Automotive and Mechanical Engineering Changsha University of Science and Technology China School of Traffic and Transportation Engineering Changsha University of Science and Technology China School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China Changsha Intelligent Driving Institute China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

As human-machine interaction continues to evolve, the capacity for environmental perception is becoming increasingly crucial. Integrating the two most common types of sensory data, images, and point clouds, can enhance detection accuracy. Currently, there is no existing model capable of detecting an object's position in both point clouds and images while also determining their corresponding relationship. This information is invaluable for human-machine interactions, offering new possibilities for their enhancement. In light of this, this paper introduces an end-to-end Consistency Object Detection (COD) algorithm framework that requires only a single forward inference to simultaneously obtain an object's position in both point clouds and images and establish their correlation. Furthermore, to assess the accuracy of the object correlation between point clouds and images, this paper proposes a new evaluation metric, Consistency Precision (CP). To verify the effectiveness of the proposed framework, an extensive set of experiments has been conducted on the KITTI and DAIR-V2X datasets. The study also explored how the proposed consistency detection method performs on images when the calibration parameters between images and point clouds are disturbed, compared to existing post-processing methods. The experimental results demonstrate that the proposed method exhibits ex-cellent detection performance and robustness, achieving end-to-end consistency detection. The source code will be made publicly available at https://***/xifen523/COD.

关键词： Point cloud compression Human computer interaction Measurement Accuracy Correlation Source coding Instruments Object detection Robustness Inference algorithms

来源：评论

学校读者我要写书评

暂无评论

High-Speed Trajectory Tracking control for Quadrotors via Deep Reinforcement Learning

High-Speed Trajectory Tracking Control for Quadrotors via De...

引用

Youth Academic Annual Conference of Chinese Association of Automation (YAC)

作者： Hean Hua Hang Zhong Hui Zhang Yongchun Fang Yaonan Wang College of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Visual Perception and Control Technology Changsha China School of Robotics Hunan University Changsha China Institute of Robotics and Automatic Information System College of Artificial Intelligence Nankai University Tianjin Key Laboratory of Intelligent Robotics Nankai University Tianjin China

ISBN: (数字)9798350379228

ISBN: (纸本)9798350390780

This paper presents a learning-based high-speed trajectory tracking control strategy for quadrotors, which achieves efficient learning and strong reliability by the collaboration of deep reinforcement learning (RL) and self-tuning mechanism. Different from existing methods, the proposed strategy is designed to explore optimal control performance by taking advantage of model-based self-tuning mechanism and deep reinforcement learning. Specifically, the self-tuning guided deep RL scheme is put forward for quadrotors, with superior learning efficiency and strong adaptability. Firstly, a novel self-tuning mechanism is constructed and some auxiliary variables are introduced to enhance the tracking performance. Then, based on the model-driven self-tuning design, the deep RL is proposed to achieve model-guided learning, where the tuning actions are adopted in the evaluation process during training, aiming at removing the bad explorations by the carefully designed parallel evaluation. Finally, the convergence is analyzed based on the proposed learning framework, which indicates the efficient cooperation of exploration and self-tuning mechanism. To verify the effectiveness of the proposed controller, the guided training and hardware experiments are implemented to show efficient cooperation and satisfactory high-speed trajectory tracking control of the proposed method.

关键词： Training Adaptation models Trajectory tracking Heuristic algorithms Optimal control Deep reinforcement learning Hardware

来源：评论

学校读者我要写书评

暂无评论

Robust Nonlinear Observer-based Adaptive visual Servo control for a Multirotor

Robust Nonlinear Observer-based Adaptive Visual Servo Contro...

引用

IEEE International Conference on Real-time Computing and robotics (RCAR)

作者： Yu Long Hang Zhong Zhenyu Qian Min Liu Hui Zhang Yiming Jiang Yaonan Wang College of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Visual Perception and Control Changsha China College of Robotics Hunan University Changsha China Senior Engineer of China Highway Engineering Consulting- Corporation (CHECC) China Highway Engineering ConsultingCorporation DATA CO. LTD Beijing China

ISBN: (数字)9798350372601

ISBN: (纸本)9798350372618

In this article, an robust nonlinear observer-based visual servo adaptive control strategy is investigated for a multirotor for stable tracking of targets. This article uses the Newton Euler equation to model the dynamics of the multirotor and describes the visual servo system model. In order to avoid being affected by various disturbances, this article designs disturbance observer and velocity observer to improve the robustness of the system. Based on nonlinear observers, this article designs a layered controller that includes a visual outer loop controller and an adaptive sliding mode geometric inner loop controller. To verify the feasibility of this algorithm, this article conducts simulation experiments using MATLAB and Simulink, and adds constant disturbances for verification. Both simulation experiments and experimental results in real environments show that the controller we designs has excellent stability and robustness.

关键词： visualization Adaptation models Target tracking Software packages Robustness Mathematical models Stability analysis

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：