检索结果-内蒙古大学图书馆

Global Localization: Utilizing Relative Spatio-Temporal Geometric Constraints from Adjacent and Distant Cameras

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Altillawi, Mohammad Pataki, Zador Li, Shile Liu, Ziyuan AI Robotics & Simulation Huawei Munich Research Center Germany Computer Vision Center Universitat Autònoma de Barcelona Spain Computer Vision and Geometry Lab ETH Zurich Switzerland

Re-localizing a camera from a single image in a previously mapped area is vital for many computer vision applications in robotics and augmented/virtual reality. In this work, we address the problem of estimating the 6 DoF camera pose relative to a global frame from a single image. We propose to leverage a novel network of relative spatial and temporal geometric constraints to guide the training of a Deep Network for localization. We employ simultaneously spatial and temporal relative pose constraints that are obtained not only from adjacent camera frames but also from camera frames that are distant in the spatio-temporal space of the scene. We show that our method, through these constraints, is capable of learning to localize when little or very sparse ground-truth 3D coordinates are available. In our experiments, this is less than 1% of available ground-truth data. We evaluate our method on 3 common visual localization datasets and show that it outperforms other direct pose estimation methods. © 2023, CC BY-NC-SA.

关键词： Cameras

*** 1.0: The Full Autonomous Stack for Oval Racing at High Speeds

学校读者我要写书评

暂无评论

Field Robotics

Field robotics 2025年 4卷 99-137页

作者： Ayoub Raji Danilo Caporale Francesco Gatti Andrea Giove Micaela Verucchi Davide Malatesta Nicola Musiu Alessandro Toschi Silviu Roberto Popitanu Fabio Bagni Massimiliano Bosi Alexander Liniger Marko Bertogna Daniele Morra Francesco Amerotti Luca Bartoli Federico Martello Riccardo Porta University of Modena and Reggio Emilia Italy University of Parma Italy Technology Innovation Institute-Autonomous Robotics Research Center UAE HIPERT srl University of Pisa Italy HIPERT srl Computer Vision Lab ETH Zurich Switzerland

The Indy Autonomous Challenge (IAC) brought together for the first time in history nine autonomous racing teams competing at an unprecedented speed and in a head-to-head scenario, using independently developed software on open-wheel race cars. This paper presents the complete software architecture used by the team TII EuroRacing (TII-ER), covering all the modules needed to avoid static obstacles, perform active overtakes, and reach speeds above 75m/s (270km/h). In addition to the most common modules related to perception, planning, and control, we discuss the approaches used for vehicle dynamics modeling, simulation, telemetry, and safety. Overall results and the performance of each module are described, as well as the lessons learned during the first two events of the competition on oval tracks, where the team placed second and third, respectively.

关键词： Automobiles Cameras Laser radar Autonomous vehicles Location awareness Safety Planning Vehicle dynamics Testing Sports Motion planning Environmental monitoring

LiCAR: pseudo-RGB LiDAR image for CAR segmentation

学校读者我要写书评

暂无评论

arXiv 2025年

作者： de Loyola Páez-Ubieta, Ignacio Velasco-Sánchez, Edison P. Puente, Santiago T. AUtomatics RObotics and Artificial Vision Lab IUII: University Institute for Computer Research University of Alicante Crta. San Vicente s/n San Vicente del Raspeig AlicanteE-03690 Spain

With the advancement of computing resources, an increasing number of Neural Networks (NNs) are appearing for image detection and segmentation appear. However, these methods usually accept as input a RGB 2D image. On the other side, Light Detection And Ranging (LiDAR) sensors with many layers provide images that are similar to those obtained from a traditional low resolution RGB camera. Following this principle, a new dataset for segmenting cars in pseudo-RGB images has been generated. This dataset combines the information given by the LiDAR sensor into a Spherical Range Image (SRI), concretely the reflectivity, near infrared and signal intensity 2D images. These images are then fed into instance segmentation NNs. These NNs segment the cars that appear in these images, having as result a Bounding Box (BB) and mask precision of 88% and 81.5% respectively with You Only Look Once (YOLO)-v8 large. By using this segmentation NN, some trackers have been applied so as to follow each car segmented instance along a video feed, having great performance in real world experiments. © 2025, CC BY.

关键词： Image segmentation

OPTIHROV: Optically Linked Hybrid Autonomous/Remotely Operated Vehicle, Beyond Teleoperation in a New Generation of Underwater Intervention Vehicles

学校读者我要写书评

暂无评论

OPTIHROV: Optically Linked Hybrid Autonomous/Remotely Operat...

OCEANS

作者： Roger Pi Joan Esteba Patryk Cieslak Narcís Palomeras Pedro J. Sanz Raúl Marín Pere Ridao Computer Vision and Robotics Research Institute (VICOROB) Universitat de Girona Girona Interactive and Robotic Systems Lab (IRS-Lab) Universitat Jaume I Castelló de la Plana

OPTIHROV is a proof-of-concept project to demonstrate a telerobotic system, based on an untethered, OPTIcally-connected, Hybrid Autonomous-ROV, that aims to replace light intervention ROVs operating at close range to networked infrastructures. The system is designed to bridge the gap between current ROVs, tethered to a Docking Station, and the dream of the future Intervention Autonomous Underwater Vehicle (I-AUV). OPTIHROV is a telerobotic system to perform inspection and light intervention tasks in potentially unknown and unstructured environments. It uses human-robot interaction (HRI) methods that allow the user to remotely guide the robot by launching a set of sensory-motion primitives performed by the robot *** paper presents a proof of concept demonstration of the OPTIHROV concept, where the wireless Hybrid Remotely Operated Vehicle (HROV), located in the test tank of the Universitat de Girona (UdG), is controlled/supervised from the Universitat Jaume I (UJI) in Castelló de la Plana, about 330 km away.

关键词：

*** 1.0: The Full Autonomous Stack for Oval Racing at High Speeds

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Raji, Ayoub Caporale, Danilo Gatti, Francesco Giove, Andrea Verucchi, Micaela Malatesta, Davide Musiu, Nicola Toschi, Alessandro Popitanu, Silviu Roberto Bagni, Fabio Bosi, Massimiliano Liniger, Alexander Bertogna, Marko Morra, Daniele Amerotti, Francesco Bartoli, Luca Martello, Federico Porta, Riccardo University of Modena and Reggio Emilia Italy University of Parma Italy Technology Innovation Institute - Autonomous Robotics Research Center United Arab Emirates HIPERT srl Italy University of Pisa Italy Computer Vision Lab ETH Zurich Switzerland

The Indy Autonomous Challenge (IAC) brought together for the first time in history nine autonomous racing teams competing at unprecedented speed and in head-to-head scenario, using independently developed software on open-wheel racecars. This paper presents the complete software architecture used by team TII EuroRacing (TII-ER), covering all the modules needed to avoid static obstacles, perform active overtakes and reach speeds above 75 m/s (270 km/h). In addition to the most common modules related to perception, planning, and control, we discuss the approaches used for vehicle dynamics modelling, simulation, telemetry, and safety. Overall results and the performance of each module are described, as well as the lessons learned during the first two events of the competition on oval tracks, where the team placed respectively second and third. Copyright © 2023, The Authors. All rights reserved.

关键词： Racing automobiles

Edge-guided Representation Learning for Underwater Object Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Dai, Linhui Liu, Hong Song, Pinhao Tang, Hao Ding, Runwei Li, Shengquan Key Laboratory of Machine Perception Shenzhen Graduate School Peking University Shenzhen China Robotics Research Group KU Leuven Leuven Belgium Computer Vision Lab ETH Zurich Zurich Switzerland Peng Cheng Laboratory Shenzhen China

Underwater object detection (UOD) is crucial for marine economic development, environmental protection, and the planet’s sustainable development. The main challenges of this task arise from low-contrast, small objects, and mimicry of aquatic organisms. The key to addressing these challenges is to focus the model on obtaining more discriminative information. We observe that the edges of underwater objects are highly unique and can be distinguished from low-contrast or mimicry environments based on their edges. Motivated by this observation, we propose an Edge-guided Representation Learning Network, termed ERL-Net, that aims to achieve discriminative representation learning and aggregation under the guidance of edge cues. Firstly, we introduce an edge-guided attention module to model the explicit boundary information, which generates more discriminative features. Secondly, a feature aggregation module is proposed to aggregate the multi-scale discriminative features by regrouping them into three levels, effectively aggregating global and local information for locating and recognizing underwater objects. Finally, we propose a wide and asymmetric receptive field block to enable features to have a wider receptive field, allowing the model to focus on more small object information. Comprehensive experiments on three challenging underwater datasets show that our method achieves superior performance on the UOD task. Copyright © 2023, The Authors. All rights reserved.

关键词： Object detection

Detection and depth estimation for domestic waste in outdoor environments by sensors fusion

学校读者我要写书评

暂无评论

arXiv 2022年

作者： de Páez-Ubieta, Ignacio L. Velasco-Sánchez, Edison Puente, Santiago T. Candelas, Francisco A. AUtomatics RObotics and Artificial Vision Lab Computer Science Research Institute University of Alicante San Vicente del Raspeig University Campus s/n San Vicente del Raspeig Alicante03690 Spain

In this work, we estimate the depth in which domestic waste are located in space from a mobile robot in outdoor scenarios. As we are doing this calculus on a broad range of space (0.3 - 6.0 m), we use RGB-D camera and LiDAR fusion. With this aim and range, we compare several methods such as average, nearest, median and center point, applied to those which are inside a reduced or non-reduced Bounding Box (BB). These BB are obtained from segmentation and detection methods which are representative of these techniques like Yolact, SOLO, You Only Look Once (YOLO)v5, YOLOv6 and YOLOv7. Results shown that, applying a detection method with the average technique and a reduction of BB of 40%, returns the same output as segmenting the object and applying the average method. Indeed, the detection method is faster and lighter in comparison with the segmentation one. The committed median error in the conducted experiments was 0.0298 ± 0.0544 m. © 2022, CC BY-NC-ND.

关键词： Mobile robots

Motion Planning and Control for Multi Vehicle Autonomous Racing at High Speeds

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Raji, Ayoub Liniger, Alexander Giove, Andrea Toschi, Alessandro Musiu, Nicola Morra, Daniele Verucchi, Micaela Caporale, Danilo Bertogna, Marko University of Modena and Reggio Emilia Italy University of Parma Italy Computer Vision Lab ETH Zurich Switzerland University of Pisa Italy Technology Innovation Institute Autonomous Robotics Research Center United Arab Emirates

This paper presents a multi-layer motion planning and control architecture for autonomous racing, capable of avoiding static obstacles, performing active overtakes, and reaching velocities above 75 m/s. The used offline global trajectory generation and the online model predictive controller are highly based on optimization and dynamic models of the vehicle, where the tires and camber effects are represented in an extended version of the basic Pacejka Magic Formula. The proposed single-track model is identified and validated using multi-body motorsport libraries which allow simulating the vehicle dynamics properly, especially useful when real experimental data are missing. The fundamental regularization terms and constraints of the controller are tuned to reduce the rate of change of the inputs while assuring an acceptable velocity and path tracking. The motion planning strategy consists of a Frenét-Frame-based planner which considers a forecast of the opponent produced by a Kalman filter. The planner chooses the collision-free path and velocity profile to be tracked on a 3 seconds horizon to realize different goals such as following and overtaking. The proposed solution has been applied on a Dallara AV-21 racecar and tested at oval race tracks achieving lateral accelerations up to 25 m/s2 Copyright © 2022, The Authors. All rights reserved.

关键词： Motion planning

Platform-portable reinforcement learning methods to localize underwater targets

学校读者我要写书评

暂无评论

Platform-portable reinforcement learning methods to localize...

OCEANS

作者： Ivan Masmitja Mario Martin Tom O’Reilly Narcis Palomeras Kakani Katija Joan Navarro Institut de Ciències del Mar (ICM) CSIC Barcelona Spain KEMLG Research Group Universitat Politècnica de Catalunya Barcelona Tech. Barcelona Spain Monterey Bay Aquarium Research Institute Moss Landing USA Computer Vision and Robotics Institute Universitat de Girona Girona Spain Bioinspiration Lab Monterey Bay Aquarium Research Institute Moss Landing USA

Subsea residential autonomous systems will reduce the cost and CO 2 footprint of future subsea operations. This concept includes subsea docking stations (SDS) and Autonomous Underwater Vehicles (AUVs). To ensure the AUVs are capable of interfacing with the SDS, a driftless and accurate close-range navigation schema is required. Thus, this paper proposes a visual method for navigation utilizing a defined set of ArUco markers printed on the SDS. To increase the accuracy of the system, the set of ArUco markers is defined to a common frame of reference, introducing more points in the camera frame for a more accurate solution to the Perspective-n-Point problem. This makes the system robust against partial occlusion. The paper has also implemented a modified Line of Sight (LOS) schema for the guidance of the vehicle. The results show stable pose estimates at up to 6 meters above the SDS, and successful autonomous docking of an underwater vehicle. The navigational estimates provided by the system get more stable when the vehicle is closer to the SDS.

关键词：