检索结果-内蒙古大学图书馆

arXiv 2025年

作者： Liu, Jian Sun, Wei Yang, Hui Deng, Pengchao Liu, Chongpei Sebe, Nicu Rahmani, Hossein Mian, Ajmal National Engineering Research Center for Robot Visual Perception and Control Technology College of Electrical and Information Engineering School of Robotics State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body Hunan University Changsha410082 China Institute of Artificial Intelligence and Robotics Xi’an Jiaotong University Xi’an710049 China Department of Information Engineering and Computer Science University of Trento Trento38123 Italy School of Computing and Communications Lancaster University LA1 4YW United Kingdom Department of Computer Science The University of Western Australia WA6009 Australia

Nine-degrees-of-freedom (9-DoF) object pose and size estimation is crucial for enabling augmented reality and robotic manipulation. Category-level methods have received extensive research attention due to their potential for generalization to intra-class unknown objects. However, these methods require manual collection and labeling of large-scale real-world training data. To address this problem, we introduce a diffusion-based paradigm for domain-generalized category-level 9-DoF object pose estimation. Our motivation is to leverage the latent generalization ability of the diffusion model to address the domain generalization challenge in object pose estimation. This entails training the model exclusively on rendered synthetic data to achieve generalization to real-world scenes. We propose an effective diffusion model to redefine 9-DoF object pose estimation from a generative perspective. Our model does not require any 3D shape priors during training or inference. By employing the Denoising Diffusion Implicit Model, we demonstrate that the reverse diffusion process can be executed in as few as 3 steps, achieving near real-time performance. Finally, we design a robotic grasping system comprising both hardware and software components. Through comprehensive experiments on two benchmark datasets and the real-world robotic system, we show that our method achieves state-of-the-art domain generalization performance. Our code will be made public at https://***/CNJianLiu/Diff9D. Copyright © 2025, The Authors. All rights reserved.

关键词： Augmented reality

来源：评论

学校读者我要写书评

暂无评论

An Efficient Planning and control Framework for Quadrotors Based on Heuristic Search and Data-Driven Model Predictive control

引用

IEEE Transactions on Industrial Electronics 2025年

作者： Wang, Sifei Wang, Yaonan Miao, Zhiqiang Wang, Xiangke He, Wei Wang, Hesheng Hunan University College of Electrical and Information Engineering Changsha 410082 China National Engineering Research Center for Robot Visual Perception and Control Changsha 410082 China National University of Defense Technology College of Intelligence Science and Technology Changsha 410073 China Beijing Information Science and Technology University School of Automation Institute of Artificial Intelligence Beijing 100083 China University of Science and Technology School of Intelligence Science and Technology Beijing 100083 China Shanghai Jiao Tong University Department of Automation Shanghai 200240 China Ministry of Education of China Key Laboratory of System Control and Information Processing Shanghai 200240 China Harbin Institute of Technology State Key Laboratory of Robotics and System Harbin 150001 China

This article presents a framework for quadrotors that integrate planning and control, which employs a heuristic depth-first search (HDFS) with data-driven model predictive control (MPC). The proposed framework intends to enable multiquadrotor systems to traverse cluttered environments containing obstacles and disturbances. The heuristic function enables quadrotors to identify a secure route in a timely manner. The heuristic function setup employed by HDFS results in a reduction in the number of rasters accessed, particularly in scenarios that are not labyrinthine. This consequently leads to an enhancement in computational speed for multiquadrotor systems when compared to the A* algorithm. Furthermore, data-driven MPC enhances the nominal model of the quadrotor by modeling the disturbance while tracking the desired states. Consequently, data-driven MPC is capable of attaining superior tracking precision in a disturbance environment when compared to MPC without data-driven. The transformation from the path to the desired states of the quadrotor is achieved through the utilization of B-splines and differential flatness. Simulations and experiments substantiate the efficacy of the proposed approach. © 1982-2012 IEEE.

关键词： Collision avoidance data-driven depth-first search model predictive control multiquadrotor systems

来源：评论

学校读者我要写书评

暂无评论

Exploring Video-Based Driver Activity Recognition under Noisy Labels

arXiv

引用

arXiv 2025年

作者： Fan, Linjuan Wen, Di Peng, Kunyu Yang, Kailun Zhang, Jiaming Liu, Ruiping Chen, Yufan Zheng, Junwei Wu, Jiamin Han, Xudong Stiefelhagen, Rainer Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Germany School of Robotics National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China Shanghai AI Lab China University of Sussex United Kingdom

As an open research topic in the field of deep learning, learning with noisy labels has attracted much attention and grown rapidly over the past ten years. Learning with label noise is crucial for driver distraction behavior recognition, as real-world video data often contains mislabeled samples, impacting model reliability and performance. However, label noise learning is barely explored in the driver activity recognition field. In this paper, we propose the first label noise learning approach for the driver activity recognition task. Based on the cluster assumption, we initially enable the model to learn clustering-friendly low-dimensional representations from given videos and assign the resultant embeddings into clusters. We subsequently perform co-refinement within each cluster to smooth the classifier outputs. Furthermore, we propose a flexible sample selection strategy that combines two selection criteria without relying on any hyperparameters to filter clean samples from the training dataset. We also incorporate a self-adaptive parameter into the sample selection process to enforce balancing across classes. A comprehensive variety of experiments on the public Drive&Act dataset for all granularity levels demonstrates the superior performance of our method in comparison with other label-denoising methods derived from the image classification field. The source code is available at https://***/ilonafan/DAR-noisy-labels. Copyright © 2025, The Authors. All rights reserved.

关键词： Object recognition

来源：评论

学校读者我要写书评

暂无评论

CoBEV: Elevating Roadside 3D Object Detection with Depth and Height Complementarity

arXiv

引用

arXiv 2023年

作者： Shi, Hao Pang, Chengshan Zhang, Jiaming Yang, Kailun Wu, Yuhao Ni, Huajian Lin, Yining Stiefelhagen, Rainer Wang, Kaiwei The State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China The Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Karlsruhe76131 Germany The Department of Engineering Science University of Oxford OxfordOX1 3PJ United Kingdom The School of Robotics Hunan University Changsha410012 China The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China Shanghai SUPREMIND Technology Co. Ltd. Shanghai201210 China

Roadside camera-driven 3D object detection is a crucial task in intelligent transportation systems, which extends the perception range beyond the limitations of vision-centric vehicles and enhances road safety. While previous studies have limitations in using only depth or height information, we find both depth and height matter and they are in fact complementary. The depth feature encompasses precise geometric cues, whereas the height feature is primarily focused on distinguishing between various categories of height intervals, essentially providing semantic context. This insight motivates the development of Complementary-BEV (CoBEV), a novel end-to-end monocular 3D object detection framework that integrates depth and height to construct robust BEV representations. In essence, CoBEV estimates each pixel's depth and height distribution and lifts the camera features into 3D space for lateral fusion using the newly proposed two-stage complementary feature selection (CFS) module. A BEV feature distillation framework is also seamlessly integrated to further enhance the detection accuracy from the prior knowledge of the fusion-modal CoBEV teacher. We conduct extensive experiments on the public 3D detection benchmarks of roadside camera-based DAIR-V2X-I and Rope3D, as well as the private Supremind-Road dataset, demonstrating that CoBEV not only achieves the accuracy of the new state-of-the-art, but also significantly advances the robustness of previous methods in challenging long-distance scenarios and noisy camera disturbance, and enhances generalization by a large margin in heterologous settings with drastic changes in scene and camera parameters. For the first time, the vehicle AP score of a camera model reaches 80% on DAIR-V2X-I in terms of easy mode. The source code will be made publicly available at CoBEV. Copyright © 2023, The Authors. All rights reserved.

关键词： Feature Selection

来源：评论

学校读者我要写书评

暂无评论

Deep Learning-Based Object Pose Estimation: A Comprehensive Survey

arXiv

引用

arXiv 2024年

作者： Liu, Jian Sun, Wei Yang, Hui Zeng, Zhiwen Liu, Chongpei Zheng, Jin Liu, Xingyu Rahmani, Hossein Sebe, Nicu Mian, Ajmal The National Engineering Research Center for Robot Visual Perception and Control Technology College of Electrical and Information Engineering the State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body Hunan University Changsha410082 China The School of Architecture and Art Central South University Changsha410082 China The Department of Automation Tsinghua University Beijing100084 China The School of Computing and Communications Lancaster University LA1 4YW United Kingdom The Department of Information Engineering and Computer Science University of Trento Trento38123 Italy The Department of Computer Science The University of Western Australia WA6009 Australia

Object pose estimation is a fundamental computer vision problem with broad applications in augmented reality and robotics. Over the past decade, deep learning models, due to their superior accuracy and robustness, have increasingly supplanted conventional algorithms reliant on engineered point pair features. Nevertheless, several challenges persist in contemporary methods, including their dependency on labeled training data, model compactness, robustness under challenging conditions, and their ability to generalize to novel unseen objects. A recent survey discussing the progress made on different aspects of this area, outstanding challenges, and promising future directions, is missing. To fill this gap, we discuss the recent advances in deep learning-based object pose estimation, covering all three formulations of the problem, i.e., instance-level, category-level, and unseen object pose estimation. Our survey also covers multiple input data modalities, degrees-of-freedom of output poses, object properties, and downstream tasks, providing the readers with a holistic understanding of this field. Additionally, it discusses training paradigms of different domains, inference modes, application areas, evaluation metrics, and benchmark datasets, as well as reports the performance of current state-of-the-art methods on these benchmarks, thereby facilitating the readers in selecting the most suitable method for their application. Finally, the survey identifies key challenges, reviews the prevailing trends along with their pros and cons, and identifies promising directions for future research. We also keep tracing the latest works at Awesome-Object-Pose-Estimation. Copyright © 2024, The Authors. All rights reserved.

关键词： Benchmarking

来源：评论

学校读者我要写书评

暂无评论

Modality Unified Attack for Omni-Modality Person Re-Identification

引用

IEEE Transactions on Information Forensics and Security 2025年 20卷 5577-5587页

作者： Bian, Yuan Liu, Min Yi, Yunqi Wang, Xueping Ma, Yunfeng Wang, Yaonan Hunan University National Engineering Research Center of Robot Visual Perception and Control Technology College of Electrical and Information Engineering Hunan Changsha China Hunan Normal University Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing College of Information Science and Engineering Hunan Changsha China

Deep learning based person re-identification (re-id) models have been widely employed in surveillance systems. Recent studies have demonstrated that black-box single-modality and cross-modality re-id models are vulnerable to adversarial examples (AEs), leaving the robustness of multi-modality re-id models unexplored. Due to the lack of knowledge about the specific type of model deployed in the target black-box surveillance system, we aim to generate modality unified AEs for omni-modality (single-, cross- and multi-modality) re-id models. Specifically, we propose a novel Modality Unified Attack method to train modality-specific adversarial generators to generate AEs that effectively attack different omni-modality models. A multi-modality model is adopted as the surrogate model, wherein the features of each modality are perturbed by metric disruption loss before fusion. To collapse the common features of omnimodality models, Cross Modality Simulated Disruption approach is introduced to mimic the cross-modality feature embeddings by intentionally feeding images to non-corresponding modality-specific subnetworks of the surrogate model. Moreover, Multi Modality Collaborative Disruption strategy is devised to facilitate the attacker to comprehensively corrupt the informative content of person images by leveraging a multi modality feature collaborative metric disruption loss. Extensive experiments show that our MUA method can effectively attack the omni-modality re-id models, achieving 55.9%, 24.4%, 49.0% and 62.7% mean mAP Drop Rate, respectively. © 2005-2012 IEEE.

关键词： Modality unified attack Multi Modality Collaborative Disruption Omni-Modality re-id

来源：评论

学校读者我要写书评

暂无评论

Efficient path planning for a dexterous arm–hand in complex environments

引用

robotics and Autonomous Systems 2025年 193卷

作者： Wenpei Fan Yaonan Wang Wenrui Chen Licheng Liu Conghui Tang Xin Li Mingjie Dong The College of Electrical and Information Engineering Hunan University Lushan South Road Changsha 410082 Hunan China The National Engineering Research Center for Robot Visual Perception and Control Lushan South Road Changsha 410082 Hunan China Beijing University of Technology Chaoyang District Beijing 100124 China

Path planning represents a critical research direction for dexterous arm–hand (DAH) systems. However, path planning for high-degree-of-freedom manipulators presents the following challenges: (1) time-consuming collision detection, and (2) an expanded search space due to high-dimensional configurations, particularly in dynamic environments. In this paper, a new path planning strategy based on rapidly-exploring random tree (RRT) path is proposed for the DAH. Firstly, an adaptive step-size RRT (ADA-RRT*) algorithm is proposed to avoid the tunneling problem caused by discrete collision detection. Secondly, to improve the efficiency of the algorithm in high-dimensional spaces, a hierarchical planning framework is first introduced, consisting of coarse planning and fine planning. Coarse planning quickly finds a rough path with large steps without considering the tunneling problem, which then guides the fine planning. Then, the beetle antennae optimization algorithm and multi-objective optimization algorithm are used to optimize the global path, reducing path length and improving path safety. Finally, the execution of corresponding simulations and experiments demonstrates the effectiveness and efficiency of the proposed method.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Learning compliant grasping and manipulation by teleoperation with adaptive force control

arXiv

引用

arXiv 2021年

作者： Zeng, Chao Li, Shuang Jiang, Yiming Li, Qiang Chen, Zhaopeng Yang, Chenguang Zhang, Jianwei Department of Informatics Universiẗat Hamburg Germany National Engineering Laboratory for Robot Visual Perception and Control Hunan University China Center for Cognitive Interaction Technology Bielefeld University Germany Bristol Robotics Laboratory University of the West of England United Kingdom

In this work, we focus on improving the robot's dexterous capability by exploiting visual sensing and adaptive force control. TeachNet, a vision-based teleoperation learning framework, is exploited to map human hand postures to a multifingered robot hand. We augment TeachNet, which is originally based on an imprecise kinematic mapping and position-only servoing, with a biomimetic learning-based compliance control algorithm for dexterous manipulation tasks. This compliance controller takes the mapped robotic joint angles from TeachNet as the desired goal, computes the desired joint torques. It is derived from a computational model of the biomimetic control strategy in human motor learning, which allows adapting the control variables (impedance and feedforward force) online during the execution of the reference joint angle trajectories. The simultaneous adaptation of the impedance and feedforward profiles enables the robot to interact with the environment in a compliant manner. Our approach has been verified in multiple tasks in physics simulation, i.e., grasping, opening-a-door, turning-a-cap, and touching-a-mouse, and has shown more reliable performances than the existing position control and the fixed-gain-based force control approaches. Copyright © 2021, The Authors. All rights reserved.

关键词： Remote control

来源：评论

学校读者我要写书评

暂无评论

Multiview Integration Network for Multitask robotic Surgical Scene Analysis

引用

IEEE Transactions on Instrumentation and Measurement 2025年 74卷

作者： Shen, Wenting Wang, Yaonan Liu, Min Wang, Jiazheng Ding, Renjie Zhang, Zhe Meijering, Erik Hunan University College of Electrical and Information Engineering National Engineering Research Center of Robot Visual Perception and Control Technology International Scientific and Technological Innovation Cooperation Base for Biomedical Image Processing Hunan Changsha410082 China University of New South Wales School of Computer Science and Engineering SydneyNSW2052 Australia

Surgical scene analysis holds a pivotal role in robot-assisted surgery. However, existing methods often suffer from single or little views, leading to erroneous scene analysis conclusions. To address these issues, a novel Multiview Integration Network (MVINet) is proposed, which comprehensively analyzes the surgical scene by integrating effective information from multiple views, including global, local, dynamic, and static views. As a multitask scene analysis network, MVINet could simultaneously perform semantic segmentation of surgical instruments and detection of instrument-tissue interaction. By designing a unique Global-Local Spatial Feature Memory module (G-LSFM), the joint information from globally and locally analyzed views following graph analysis simultaneously enhances the accuracy of multitask scene analysis. The Dynamic-Static visual Feature Memory module (D-SVFM) introduces an innovative approach by simultaneously incorporating temporal feature from consecutive frames and static feature from single frame into the node features of the interaction reasoning network. The multiscale perspective of both features further enhances the ability of the module to analyze the complex scenes. Experimental results on a public and a private dataset demonstrate that our method achieves superior performance compared to other state-of-the-art methods for two crucial tasks in surgical scene analysis. In the instrument segmentation task, MVINet outperforms the second-best method by 1.73% and 0.55% in terms of mIoU scores. For the interaction detection task, MVINet surpasses the second-best method by 10.14% and 5.47% in mAP scores. © 1963-2012 IEEE.

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Edge-Computing-Driven Autonomous Ubiquitous Internet of Things in Electricity: Architecture and Challenges 3

Edge-Computing-Driven Autonomous Ubiquitous Internet of Thin...

引用

3rd IEEE Conference on Energy Internet and Energy System Integration, EI2 2019

作者： Liu, Dongqi Zeng, Xiangjun Wang, Yaonan Changsha Unviersity of Science and Technology Changsha China National Engineering Laboratory for Robot Visual Perception and Control Technology Changsha China

ISBN: (纸本)9781728131375

The distribution network is developing towards the direction of Internet of Things in Electricity(IoTE). As an emerging technology of the Internet of Things(IoT), edge computing has great application potential in the future IoTE. This paper presents an architecture of edge computing-driven IoTE, whose physical layer is an electrical network containing a high proportion of power electronic devices, and its information layer is a 5G-oriented power communication network containing a large amount of power terminal and mass communication data generated by the power terminal. For the physical layer, the virtual synchronous machine(VSM) algorithm are adopted to control the large number of power electronic components so as to guarantee the dynamic stability of physical power network. For the information layer, a new layered distributed information processing architecture, the Edge Computing Architecture, is introduced to address the needs of information monitoring and protection control in the smart distribution network. The architecture of the edge computing, and the applications that may be deployed in the edge computing gateways are introduced, and the challenges may be faced by the IoTE in the future development are further discussed. © 2019 IEEE.

关键词： Internet of things

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：