检索结果-内蒙古大学图书馆

NDD: A 3D Point Cloud Descriptor Based on Normal Distribution for Loop Closure Detection

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zhou, Ruihao He, Li Zhang, Hong Lin, Xubin Guan, Yisheng The Department of Electromechanical Engineering Guangdong University of Technology China The Department of Electronic and Electrical Engineering Southern University of Science and Technology China Shenzhen Key Laboratory of Robotics and Computer Vision China

Loop closure detection is a key technology for long-term robot navigation in complex environments. In this paper, we present a global descriptor, named Normal Distribution Descriptor (NDD), for 3D point cloud loop closure detection. The descriptor encodes both the probability density score and entropy of a point cloud as the descriptor. We also propose a fast rotation alignment process and use correlation coefficient as the similarity between descriptors. Experimental results show that our approach outperforms the state-of-the-art point cloud descriptors in both accuracy and efficency. The source code is available and can be integrated into existing LiDAR odometry and mapping (LOAM) systems. © 2022, CC BY.

关键词： Normal distribution

IEEE Transactions on Biometrics, Behavior, and Identity Scie...

学校读者我要写书评

暂无评论

Editorial

IEEE Transactions on Biometrics, Behavior, and Identity science 2024年第3期6卷 289-289页

作者： Liao, Shengcai Liu, Xiaoming Tistarelli, Massimo Chellappa, Rama Kittler, Josef United Arab Emirates University College of Information Technology Al Ain United Arab Emirates Michigan State University Department of Computer Science and Engineering East LansingMI48824 United States University of Sassari Computer Vision Laboratory Sassari07100 Italy Johns Hopkins University Department of Electrical and Computer Engineering BaltimoreMD21218 United States Johns Hopkins University Department of Biomedical Engineering BaltimoreMD21218 United States University of Surrey Centre for Vision Speech and Signal Processing GuildfordGU2 7XH United Kingdom

The 2022 International Joint Conference on Biometrics (IJCB 2022) was held at Abu Dhabi, United Arab Emirates, from October 10 to October 13, 2022. This marked the first biometrics conference held in the Middle East. The IJCB 2022 conference combined two major biometrics conferences: the IEEE Biometrics Theory, Applications, and Systems (BTAS) conference and the International Conference on Biometrics (ICB). The IJCB 2022 conference was technically co-sponsored by both IAPR TC4 (Technical Committee on Biometrics) and the IEEE Biometrics Council. © 2019 IEEE.

关键词：

Distilled Transformers with Locally Enhanced Global Representations for Face Forgery Detection

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zhang, Yaning Li, Qiufu Yu, Zitong Shen, Linlin Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Guangdong Shenzhen518060 China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University Guangdong Shenzhen518060 China Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Shenzhen518129 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Guangdong Shenzhen518060 China School of Computing and Information Technology Great Bay University Guangdong Dongguan523000 China

Face forgery detection (FFD) is devoted to detecting the authenticity of face images. Although current CNN-based works achieve outstanding performance in FFD, they are susceptible to capturing local forgery patterns generated by various manipulation methods. Though transformer-based detectors exhibit improvements in modeling global dependencies, they are not good at exploring local forgery artifacts. Hybrid transformer-based networks are designed to capture local and global manipulated traces, but they tend to suffer from the attention collapse issue as the transformer block goes deeper. Besides, soft labels are rarely available. In this paper, we propose a distilled transformer network (DTN) to capture both rich local and global forgery traces and learn general and common representations for different forgery faces. Specifically, we design a mixture of expert (MoE) module to mine various robust forgery embeddings. Moreover, a locally-enhanced vision transformer (LEVT) module is proposed to learn locally-enhanced global representations. We design a lightweight multi-attention scaling (MAS) module to avoid attention collapse, which can be plugged and played in any transformer-based models with only a slight increase in computational costs. In addition, we propose a deepfake self-distillation (DSD) scheme to provide the model with abundant soft label information. Extensive experiments show that the proposed method surpasses the state of the arts on five deepfake datasets. Copyright © 2024, The Authors. All rights reserved.

关键词： Face recognition

Multi-scale Contrastive Learning for Gastroenteroscopy Classification

学校读者我要写书评

暂无评论

Multi-scale Contrastive Learning for Gastroenteroscopy Class...

Annual IEEE Symposium on computer-Based Medical Systems

作者： Dan Li Xuechen Li Zhibin Peng Wenting Chen Linlin Shen Guangyao Wu Computer Vision Institute School of Computer Science & Software Engineering Shenzhen University National Engineering Laboratory for Big Data System Computing Technology ShenZhen University Shenzhen China City University of Hong Kong Hong Kong SAR China Shenzhen Institute of Artificial Intelligence & Robotics for Society Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University General Hospital

In gastroenteroscopy image analysis, numerous CADs demonstrate that deep learning aids doctors' diagnosis. The shapes and sizes of the lesions are varied. And in the clinic, the dataset appears to be data imbalanced. However, existing methods directly classify by texture and ignore lesions with various shapes and sizes. To address the issue above, we propose a deep neural network, which consists of multi-scale feature extraction, contrastive feature learning and a multi-scale feature fusion module. We train the contrastive feature learning module and multi-scale feature fusion module simultaneously to alleviate the issue of data distribution differences. Thus, the proposed network can better identify various categories. Extensive experiments on the Hyper Kvasir dataset show that the proposed Hybrid-M2CL outperforms the benchmark proposed by the dataset with 5.0% Macro Precision, 3.3% Macro Recall, 3.4% Macro F1-score, 3.3% Micro Precision, 3.6% MCC. In addition, it outperforms the SOTA by 1.1% Macro F1-score, 2.6% MCC, and 2.0% B-ACC.

关键词：

Deep Learning Methods for Ship Classification: From Visible to Infrared Images 5

学校读者我要写书评

暂无评论

Deep Learning Methods for Ship Classification: From Visible ...

5th International Conference on robotics, Intelligent Control and Artificial Intelligence, RICAI 2023

作者： Liu, Tianci Qin, Hengjia Zhan, Zhuo Liu, Yunpeng Shenyang Institute of Automation Chinese Academy of Sciences Shenyang110016 China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Shenyang110169 China University of Chinese Academy of Sciences Beijing100049 China Chinese Academy of Sciences Key Laboratory of Opto-Electronic Information Processing Shenyang110016 China Key Laboratory of Image Understanding and Computer Vision Liaoning Province Shenyang110016 China The Third Military Representative Office of the Air Force Equipment Department in Shenyang Region Liaoning Province Shenyang110027 China

ISBN: (纸本)9798350357950

Deep learning methods have achieved excellent performances on visual tasks of target recognition and classification. The rapid development of autonomous seafaring vessels comes up with the requirement to recognize other maritime ships day and night. However, the recognition of ships based on the deep neural networks may not always access the results as expectation when the ships are under the nighttime environment. To this issue, we consider the ship recognition task under the deep learning framework with paired visible images and infrared images. In this article, we propose an end-to-end convolutional network based on visible images and infrared images of the autonomous seafaring vessels. To demonstrate the effectiveness of our model, we choose the V AIS dataset to test the performance of classifying the maritime ships. Experimental results show that the proposed network outperforms the state-of-the-art methods based on the V AIS database. © 2023 IEEE.

关键词： deep learning infrared images neural network Ship recognition

NavCoT: Boosting LLM-Based vision-and-Language Navigation via Learning Disentangled Reasoning

学校读者我要写书评

暂无评论

IEEE Transactions on Pattern Analysis and Machine Intelligence 2025年第7期47卷 5945-5957页

作者： Bingqian Lin Yunshuang Nie Ziming Wei Jiaqi Chen Shikui Ma Jianhua Han Hang Xu Xiaojun Chang Xiaodan Liang Shenzhen Campus Sun Yat-sen University Shenzhen China Shanghai Jiao Tong University Shanghai China University of Hong Kong Pok Fu Lam Hong Kong Dataa Robotics Company Beijing China Huawei Noah's Ark Lab Shanghai China School of Information Science and Technology University of Science and Technology of China Hefei China Department of Computer Vision Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) Abu Dhabi UAE Peng Cheng Laboratory Shenzhen China Guangdong Key Laboratory of Big Data Analysis and Processing Guangzhou China

vision-and-Language Navigation (VLN), as a crucial research problem of Embodied AI, requires an embodied agent to navigate through complex 3D environments following natural language instructions. Recent research has highlighted the promising capacity of large language models (LLMs) in VLN by improving navigational reasoning accuracy and interpretability. However, their predominant use in an offline manner usually suffers from substantial domain gap between the VLN task and the LLM training corpus. This paper proposes a novel strategy called Nav igational C hain- o f- T hought (NavCoT), where we fulfill parameter-efficient in-domain training to enable self-guided navigational decision, leading to a significant mitigation of the domain gap in a cost-effective manner. Specifically, at each timestep, the LLM is prompted to forecast the navigational chain-of-thought by: 1) acting as a world model to imagine the next observation according to the instruction, 2) selecting the candidate observation that best aligns with the imagination, and 3) determining the action based on the reasoning from the prior steps. In this way, the action prediction can be effectively simplified benefiting from the disentangled reasoning. Through constructing formalized labels for training, the LLM can learn to generate desired and reasonable chain-of-thought outputs for improving the action decision. Experimental results across various training settings and popular VLN benchmarks (e.g., Room-to-Room (R2R), Room-across-Room (RxR), Room-for-Room (R4R)) show the significant superiority of NavCoT over the direct action prediction variants. Through simple parameter-efficient finetuning, our NavCoT outperforms a recent GPT4-based approach with $\sim$ 7% relative improvement on the R2R dataset. We believe that NavCoT will help unlock more task-adaptive and scalable LLM-based embodied agents, which are helpful for developing real-world robotics applications.

关键词： Navigation Cognition Training Scalability Glass Planning Large language models History Electronic mail Visualization

Spiral coverage path planning for Multi-UAV photovoltaic panel inspection applications

学校读者我要写书评

暂无评论

Spiral coverage path planning for Multi-UAV photovoltaic pan...

International Conference on Unmanned Aircraft Systems (ICUAS)

作者： Marco Andrés Luna Mohammad Sadeq Ale Isaac Miguel Fernandez-Cortizas Carlos Santos Ahmed Refaat Ragab Martin Molina Pascual Campoy Computer Vision and Aerial Robotics Group (CVAR) Centre for Automation and Robotics (C.A.R.) Universidad Politécnica de Madrid (UPM-CSIC) Madrid Spain Department of Signal Theory and Communications University of Alcala (UAH) Madrid Spain Department of Network Faculty of Information Systems and Computer Science October 6 University Giza Egypt Department of Artificial Intelligence Universidad Politécnica de Madrid Madrid Spain

This paper deals with the problem of coverage path planning for multiple UAVs in disjoint regions. For this purpose, a spiral-coverage path planning algorithm is proposed. Additionally, task assignment methods for multi-region inspection with a swarm of UAVs are applied. The centralized system architecture is described, and an adaptive sliding mode controller is designed. Furthermore, we evaluate the performance of the proposed techniques by obtaining numerical results and simulations with the controller. The results show that the spiral pattern optimizes the cost of the mission and improves the task distribution of the mission planning system. Additionally, the performance of the proposed controller is robust to simulated disturbances.

关键词：

Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimation

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Liu, Jian Sun, Wei Yang, Hui Deng, Pengchao Liu, Chongpei Sebe, Nicu Rahmani, Hossein Mian, Ajmal National Engineering Research Center for Robot Visual Perception and Control Technology College of Electrical and Information Engineering School of Robotics State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body Hunan University Changsha410082 China Institute of Artificial Intelligence and Robotics Xi’an Jiaotong University Xi’an710049 China Department of Information Engineering and Computer Science University of Trento Trento38123 Italy School of Computing and Communications Lancaster University LA1 4YW United Kingdom Department of Computer Science The University of Western Australia WA6009 Australia

Nine-degrees-of-freedom (9-DoF) object pose and size estimation is crucial for enabling augmented reality and robotic manipulation. Category-level methods have received extensive research attention due to their potential for generalization to intra-class unknown objects. However, these methods require manual collection and labeling of large-scale real-world training data. To address this problem, we introduce a diffusion-based paradigm for domain-generalized category-level 9-DoF object pose estimation. Our motivation is to leverage the latent generalization ability of the diffusion model to address the domain generalization challenge in object pose estimation. This entails training the model exclusively on rendered synthetic data to achieve generalization to real-world scenes. We propose an effective diffusion model to redefine 9-DoF object pose estimation from a generative perspective. Our model does not require any 3D shape priors during training or inference. By employing the Denoising Diffusion Implicit Model, we demonstrate that the reverse diffusion process can be executed in as few as 3 steps, achieving near real-time performance. Finally, we design a robotic grasping system comprising both hardware and software components. Through comprehensive experiments on two benchmark datasets and the real-world robotic system, we show that our method achieves state-of-the-art domain generalization performance. Our code will be made public at https://***/CNJianLiu/Diff9D. Copyright © 2025, The Authors. All rights reserved.

关键词： Augmented reality

Low-Light Enhancement Effect on Classification and Detection: An Empirical Study

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wu, Xu Lai, Zhihui Jie, Zhou Gao, Can Hou, Xianxu Zhang, Ya-Nan Shen, Linlin The Computer Vision Institute College of Computer Science and Software Engineering Shenzhen University Shenzhen518060 China Shenzhen Institute of Artificial Intelligence and Robotics for Society Shenzhen518060 China Guangdong Key Laboratory of Intelligent Information Processing Shenzhen University Shenzhen518060 China School of AI and Advanced Computing Xi’an Jiaotong-Liverpool University China The National Engineering Laboratory for Big Data System Computing Technology Shenzhen University SZU Branch Shenzhen Institute of Artificial Intelligence and Robotics for Society Guangdong Shenzhen518060 China

Low-light images are commonly encountered in real-world scenarios, and numerous low-light image enhancement (LLIE) methods have been proposed to improve the visibility of these images. The primary goal of LLIE is to generate clearer images that are more visually pleasing to humans. However, the impact of LLIE methods in high-level vision tasks, such as image classification and object detection, which rely on high-quality image datasets, is not well explored. To explore the impact, we comprehensively evaluate LLIE methods on these high-level vision tasks by utilizing an empirical investigation comprising image classification and object detection experiments. The evaluation reveals a dichotomy: While Low-Light Image Enhancement (LLIE) methods enhance human visual interpretation, their effect on computer vision tasks is inconsistent and can sometimes be harmful. Our findings suggest a disconnect between image enhancement for human visual perception and for machine analysis, indicating a need for LLIE methods tailored to support high-level vision tasks effectively. This insight is crucial for the development of LLIE techniques that align with the needs of both human and machine vision. Copyright © 2024, The Authors. All rights reserved.

关键词： Machine vision