检索结果-内蒙古大学图书馆

Watch Your STEPP: Semantic Traversability Estimation using Pose Projected Features

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Ægidius, Sebastian Hadjivelichkov, Dennis Jiao, Jianhao Embley-Riches, Jonathan Kanoulas, Dimitrios Robot Perception and Learning Lab Department of Computer Science University College London Gower Street LondonWC1E 6BT United Kingdom Archimedes RC Athens Greece

Understanding the traversability of terrain is essential for autonomous robot navigation, particularly in unstructured environments such as natural landscapes. Although traditional methods, such as occupancy mapping, provide a basic framework, they often fail to account for the complex mobility capabilities of some platforms such as legged robots. In this work, we propose a method for estimating terrain traversability by learning from demonstrations of human walking. Our approach leverages dense, pixel-wise feature embeddings generated using the DINOv2 vision Transformer model, which are processed through an encoder-decoder MLP architecture to analyze terrain segments. The averaged feature vectors, extracted from the masked regions of interest, are used to train the model in a reconstruction-based framework. By minimizing reconstruction loss, the network distinguishes between familiar terrain with a low reconstruction error and unfamiliar or hazardous terrain with a higher reconstruction error. This approach facilitates the detection of anomalies, allowing a legged robot to navigate more effectively through challenging terrain. We run real-world experiments on the ANYmal legged robot both indoor and outdoor to prove our proposed method. The code is open-source, while video demonstrations can be found on our website: https://***/STEPP/ © 2025, CC BY.

关键词： Open source software

FrontierNet: learning Visual Cues to Explore

学校读者我要写书评

暂无评论

IEEE robotics and Automation Letters 2025年第7期10卷 6576-6583页

作者： Sun, Boyang Chen, Hanzhi Leutenegger, Stefan Cadena, Cesar Pollefeys, Marc Blum, Hermann ETH Zurich Computer Vision and Geometry Group Zurich 8092 Switzerland Technical University of Munich Mobile Robotics Lab München 80333 Germany ETH Zurich Mobile Robotics Lab Zurich 8092 Switzerland ETH Zurich Robotic Systems Lab Zurich 8092 Switzerland AI Lab Microsoft Mixed Reality Zurich 8038 Switzerland University of Bonn Lamarr Institute for ML and AI Robot Perception and Learning Lab Bonn 53115 Germany

Exploration of unknown environments is crucial for autonomous robots;it allows them to actively reason and decide on what new data to acquire for different tasks, such as mapping, object discovery, and environmental assessment. Existing solutions, such as frontier-based exploration approaches, rely heavily on 3D map operations, which are limited by map quality and, more critically, often overlook valuable context from visual cues. This work aims at leveraging 2D visual cues for efficient autonomous exploration, addressing the limitations of extracting goal poses from a 3D map. We propose a visual-only frontier-based exploration system, with FrontierNet as its core component. FrontierNet is a learning-based model that (i) proposes frontiers, and (ii) predicts their information gain, from posed RGB images enhanced by monocular depth priors. Our approach provides an alternative to existing 3D-dependent goal-extraction approaches, achieving a 15% improvement in early-stage exploration efficiency, as validated through extensive simulations and real-world experiments. © 2016 IEEE.

关键词： Deep learning Motion and Path Planning perception and Autonomy

Global Tensor Motion Planning

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Le, An T. Hansel, Kay Carvalho, João Watson, Joe Urain, Julen Biess, Armin Chalvatzaki, Georgia Peters, Jan Intelligent Autonomous Systems Lab TU Darmstadt Germany Germany Hessian.AI Centre for Cognitive Science Interactive Robot Perception & Learning Lab TU Darmstadt Germany

Batch planning is increasingly necessary to quickly produce diverse and high-quality motion plans for downstream learning applications, such as distillation and imitation learning. This paper presents Global Tensor Motion Planning (GTMP)—a sampling-based motion planning algorithm comprising only tensor operations. We introduce a novel discretization structure represented as a random multipartite graph, enabling efficient vectorized sampling, collision checking, and search. We provide a theoretical investigation showing that GTMP exhibits probabilistic completeness while supporting modern GPU/TPU. Additionally, by incorporating smooth structures into the multipartite graph, GTMP directly plans smooth splines without requiring gradient-based optimization. Experiments on lidar-scanned occupancy maps and the MotionBenchMarker dataset demonstrate GTMP’s computation efficiency in batch planning compared to baselines, underscoring GTMP’s potential as a robust, scalable planner for diverse applications and large-scale robot learning tasks. Copyright © 2024, The Authors. All rights reserved.

关键词： Tensors

ASFM: Augmented Social Force Model for Legged robot Social Navigation 23

学校读者我要写书评

暂无评论

ASFM: Augmented Social Force Model for Legged Robot Social N...

23rd IEEE-RAS International Conference on Humanoid robots, Humanoids 2024

作者： Ægidius, Sebastian Chacón-Quesada, Rodrigo Delfaki, Andromachi Maria Kanoulas, Dimitrios Demiris, Yiannis Imperial College London Personal Robotics Lab Department of Electrical and Electronic Engineering LondonSW7 2AZ United Kingdom University College London Robot Perception and Learning Lab Department of Computer Science Gower Street LondonWC1E 6BT United Kingdom Ai Centre Department of Computer Science Ucl United Kingdom Archimedes/Athena Rc Greece

ISBN: (纸本)9798350373578

Social navigation in robotics primarily involves guiding mobile robots through human-populated areas, with pedestrian comfort balanced with efficient path-finding. Although progress has been seen in this field, a solution for the seamless integration of robots into pedestrian settings remains elusive. In this paper, a social force model for legged robots is developed, utilizing visual perception for human localization. In particular, an augmented social force model is introduced, incorporating refined interpretations of repulsive forces and avoidance behaviors based on pedestrian actions, alongside a target following mechanism. Experimental evaluation on a quadruped robot, through various scenarios, including interactions with oncoming pedestrians, crowds, and obstructed paths, demonstrates that the proposed augmented model significantly improves upon previous baseline methods in terms of chosen path length, average velocity, and time-to-goal for effective and efficient social navigation. The code isopen-source, while video demonstrations can be found on the project's webpage: https://***/ASFM/ © 2024 IEEE.

关键词： Mobile robots

Grapevine Winter Pruning Automation: On Potential Pruning Points Detection through 2D Plant Modeling using Grapevine Segmentation 11

学校读者我要写书评

暂无评论

Grapevine Winter Pruning Automation: On Potential Pruning Po...

11th IEEE Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems, CYBER 2021

作者： Fernandes, Miguel Scaldaferri, Antonello Fiameni, Giuseppe Teng, Tao Gatti, Matteo Poni, Stefano Semini, Claudio Caldwell, Darwin Chen, Fei Active Perception and Robot Interactive Learning Laboratory Istituto Italiano di Tecnologia Department of Advanced Robotics Genova16163 Italy Italy Università Cattolica Del Sacro Cuore Department of Sustainable Crop Production Piacenza29122 Italy Lab Istituto Italiano di Tecnologia Genova16163 Italy T-Stone Robotics Institute The Chinese University of Hong Kong Department of Mechanical and Automation Engineering Hong Kong

ISBN: (纸本)9781665425278

Grapevine winter pruning is a complex task, that requires skilled workers to execute it correctly. The complexity of this task is also the reason why it is time consuming. Considering that this operation takes about 80-120 hours/ha to be completed, and therefore is even more crucial in large-size vineyards, an automated system can help to speed up the process. To this end, this paper presents a novel multidisciplinary approach that tackles this challenging task by performing object segmentation on grapevine images, used to create a representative model of the grapevine plants. Second, a set of potential pruning points is generated from this plant representation. We will describe (a) a methodology for data acquisition and annotation, (b) a neural network fine-tuning for grapevine segmentation, (c) an image processing based method for creating the representative model of grapevines, starting from the inferred segmentation and (d) potential pruning points detection and localization, based on the plant model which is a simplification of the grapevine structure. With this approach, we are able to identify a significant set of potential pruning points on the canes, that can be used, with further selection, to derive the final set of the real pruning points. © 2021 IEEE.

关键词： Data acquisition

ASFM: Augmented Social Force Model for Legged robot Social Navigation

学校读者我要写书评

暂无评论

ASFM: Augmented Social Force Model for Legged Robot Social N...

IEEE-RAS International Conference on Humanoid robots

作者： Sebastian Ægidius Rodrigo Chacón-Quesada Andromachi Maria Delfaki Dimitrios Kanoulas Yiannis Demiris Department of Computer Science Robot Perception and Learning Lab University College London Gower Street London UK Department of Electrical and Electronic Engineering Personal Robotics Lab Imperial College London London UK Department of Computer Science AI Centre UCL and the Archimedes/Athena RC Greece

ISBN: (数字)9798350373578

ISBN: (纸本)9798350373585

关键词： Legged locomotion Location awareness Pedestrians Codes Navigation Force Humanoid robots Quadrupedal robots Visual perception

FusionPortableV2: A Unified Multi-Sensor Dataset for Generalized SLAM Across Diverse Platforms and Scalable Environments

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wei, Hexiang Jiao, Jianhao Hu, Xiangcheng Yu, Jingwen Xie, Xupeng Wu, Jin Zhu, Yilong Liu, Yuxuan Wang, Lujia Liu, Ming Department of Electronic and Computer Engineering The Hong Kong University of Science and Technology Hong Kong Robot Perception and Learning Lab Department of Computer Science University College London United Kingdom Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology China Guangzhou China

Simultaneous Localization and Mapping (SLAM) technology has been widely applied in various robotic scenarios, from rescue operations to autonomous driving. However, the generalization of SLAM algorithms remains a significant challenge, as current datasets often lack scalability in terms of platforms and environments. To address this limitation, we present FusionPortableV2, a multi-sensor SLAM dataset featuring sensor diversity, varied motion patterns, and a wide range of environmental scenarios. Our dataset comprises 27 sequences, spanning over 2.5 hours and collected from four distinct platforms: a handheld suite, a legged robot, a unmanned ground vehicle (UGV), and a vehicle. These sequences cover diverse settings, including buildings, campuses, and urban areas, with a total length of 38.7km. Additionally, the dataset includes ground-truth (GT) trajectories and RGB point cloud maps covering approximately 0.3km2. To validate the utility of our dataset in advancing SLAM research, we assess several state-of-the-art (SOTA) SLAM algorithms. Furthermore, we demonstrate the dataset's broad application beyond traditional SLAM tasks by investigating its potential for monocular depth estimation. The completae dataset, including sensor data, GT, and calibration details, is accessible at https://***/dataset/fusionportable v2. Copyright © 2024, The Authors. All rights reserved.

关键词： SLAM robotics

LoGS: Visual Localization via Gaussian Splatting with Fewer Training Images

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Cheng, Yuzhou Jiao, Jianhao Wang, Yue Kanoulas, Dimitrios Robot Perception and Learning Lab Intelligent Robotics Department of Computer Science University College London Gower Street LondonWC1E 6BT United Kingdom Zhejiang University Zhejiang Hangzhou China AI Centre Department of Computer Science University College London Gower Street LondonWC1E 6BT United Kingdom Archimedes/Athena RC Greece

Visual localization involves estimating a query image’s 6-DoF (degrees of freedom) camera pose, which is a fundamental component in various computer vision and robotic tasks. This paper presents LoGS, a vision-based localization pipeline utilizing the 3D Gaussian Splatting (GS) technique as scene representation. This novel representation allows high-quality novel view synthesis. During the mapping phase, structure-from-motion (SfM) is applied first, followed by the generation of a GS map. During localization, the initial position is obtained through image retrieval, local feature matching coupled with a PnP solver, and then a high-precision pose is achieved through the analysis-by-synthesis manner on the GS map. Experimental results on four large-scale datasets demonstrate the proposed approach’s SoTA accuracy in estimating camera poses and robustness under challenging few-shot conditions. © 2024, CC BY.

关键词： Gaussian distribution

LiteVLoc: Map-Lite Visual Localization for Image Goal Navigation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Jiao, Jianhao He, Jinhao Liu, Changkun Aegidius, Sebastian Hu, Xiangcheng Braud, Tristan Kanoulas, Dimitrios The Robot Perception and Learning Lab Intelligent Robotics Department of Computer Science University College London Gower Street LondonWC1E 6BT United Kingdom Nansha District Guangzhou China The Department of Computer Science and Engineering HKUST Hong Kong The Department of Electronic an Computer Engineering HKUST Hong Kong The AI Centre Department of Computer Science University College London Gower Street LondonWC1E 6BT United Kingdom Archimedes/Athena RC Greece

This paper presents LiteVLoc, a hierarchical visual localization framework that uses a lightweight topo-metric map to represent the environment. The method consists of three sequential modules that estimate camera poses in a coarse-to-fine manner. Unlike mainstream approaches relying on detailed 3D representations, LiteVLoc reduces storage overhead by leveraging learning-based feature matching and geometric solvers for metric pose estimation. A novel dataset for the map-free relocalization task is also introduced. Extensive experiments including localization and navigation in both simulated and real-world scenarios have validate the system's performance and demonstrated its precision and efficiency for large-scale deployment. Code and data will be made publicly available at https://***/LiteVLoc. Copyright © 2024, The Authors. All rights reserved.

关键词： Visualization