检索结果-内蒙古大学图书馆

Exploring Unstructured Environments using Minimal Sensing on Cooperative Nano-Drones

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Arias-Perez, Pedro Gautam, Alvika Fernandez-Cortizas, Miguel Perez-Saura, David Saripalli, Srikanth Campoy, Pascual The Computer Vision and Aerial Robotics Group Universidad Politécnica de Madrid Spain Spain The Department of Mechanical Engineering Texas A&M University College StationTX United States

Recent advances have improved autonomous navigation and mapping under payload constraints, but current multi-robot inspection algorithms are unsuitable for nano-drones due to their need for heavy sensors and high computational resources. To address these challenges, we introduce ExploreBug, a novel hybrid frontier range bug algorithm designed to handle limited sensing capabilities for a swarm of nano-drones. This system includes three primary components: a mapping subsystem, an exploration subsystem, and a navigation subsystem. Additionally, an intra-swarm collision avoidance system is integrated to prevent collisions between drones. We validate the efficacy of our approach through extensive simulations and real-world exploration experiments involving up to seven drones in simulations and three in real-world settings, across various obstacle configurations and with a maximum navigation speed of 0.75 m/s. Our tests demonstrate that the algorithm efficiently completes exploration tasks, even with minimal sensing, across different swarm sizes and obstacle densities. Furthermore, our frontier allocation heuristic ensures an equal distribution of explored areas and paths traveled by each drone in the swarm. We publicly release the source code of the proposed system to foster further developments in mapping and exploration using autonomous nano drones. Video: https://***/cvarupm/cf-exploration Code: https://***/pariaspe/cf_exploration © 2024, CC BY.

关键词： Mapping

Playing cards and bidding calls detection for automatic registration of a duplicate bridge game

学校读者我要写书评

暂无评论

TechRxiv

TechRxiv 2022年

作者： Wzorek, Piotr Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Krakow Poland

In this work, the implementation of a playing cards and bidding calls detection system for the automatic registration of a duplicate bridge game is presented. For this purpose, two YOLOv4 deep convolutional neural networks were used. During the training process, which was carried out using an automatically generated dataset, we obtained a detector characterised by more than 99.9% accuracy on the test set. The prepared system has been evaluated on videos collected during bridge competitions and is characterised by high accuracy. The application has been implemented and evaluated on a CPU and an embedded GPU. © 2022, CC BY.

关键词： Deep neural networks

Energy Efficient Hardware Acceleration of Neural Networks with Power-of-Two Quantisation

学校读者我要写书评

暂无评论

arXiv 2022年

关键词： System-on-chip

Towards real-time and energy efficient Siamese tracking - a hardware-software approach

学校读者我要写书评

暂无评论

arXiv 2022年

Siamese trackers have been among the state-of-the-art solutions in each Visual Object Tracking (VOT) challenge over the past few years. However, with great accuracy comes great computational complexity: to achieve real-time processing, these trackers have to be massively parallelised and are usually run on high-end GPUs. Easy to implement, this approach is energy consuming, and thus cannot be used in many low-power applications. To overcome this, one can use energy-efficient embedded devices, such as heterogeneous platforms joining the ARM processor system with programmable logic (FPGA). In this work, we propose a hardware-software implementation of the well-known fully connected Siamese tracker (SiamFC). We have developed a quantised Siamese network for the FINN accelerator, using algorithm-accelerator co-design, and performed design space exploration to achieve the best efficiency-to-energy ratio (determined by FPS and used resources). For our network, running in the programmable logic part of the Zynq UltraScale+ MPSoC ZCU104, we achieved the processing of almost 50 frames-per-second with tracker accuracy on par with its floating point counterpart, as well as the original SiamFC network. The complete tracking system, implemented in ARM with the network accelerated on FPGA, achieves up to 17 fps. These results bring us towards bridging the gap between the highly accurate but energy-demanding algorithms and energy-efficient solutions ready to be used in low-power, edge systems. © 2022, CC BY.

关键词： Energy efficiency

Local Gaussian Modifiers (LGMs): UAV Dynamic Trajectory Generation for Onboard Computation

学校读者我要写书评

暂无评论

Local Gaussian Modifiers (LGMs): UAV Dynamic Trajectory Gene...

International Conference on Unmanned Aircraft Systems (ICUAS)

作者： Miguel Fernandez-Cortizas David Perez-Saura Rafael Perez-Segui Javier Rodriguez-Vazquez Juan S. Cely Pascual Campoy Computer Vision and Aerial Robotics group (CVAR) Centre for Automation and Robotics (CAR) Universidad Politécnica de Madrid (UPM) Madrid Spain Department of Artificial Intelligence Universidad Politécnica de Madrid Madrid Spain Intelligent Robotics Lab Rey Juan Carlos University Madrid Spain

ISBN: (数字)9798350357882

ISBN: (纸本)9798350357899

Agile autonomous drones are becoming increasingly popular in research due to the challenges they represent in fields like control, state estimation, or perception at high speeds. When all algorithms are computed onboard the UAV, computational limitations make the task of agile flight even more difficult. One of the most computationally expensive tasks in agile flight is the generation of optimal trajectories. When these trajectories must be updated online due to changes in the environment or uncertainties, this high computational cost may result in insufficient time to reach the desired waypoints, which could cause a drone crash in cluttered environments. In this paper, we present Local Gaussian Modifiers (LGMs), a fast and lightweight way of modifying computationally heavy trajectories when recalculating them in time is not possible due to computational limitations. Moreover, we propose a strategy for deciding when is convenient to use these modifiers or recalculate the whole trajectory based on an estimation of the computational time of this trajectory generation. A trajectory blending procedure is also proposed to ensure smoothness in UAV control when a new trajectory is computed. Our approach was validated in simulation, being able to pass through a race circuit with moving gates, achieving speeds up to 16.0 m/s. Real flight validation was also performed achieving speeds up to 4.0 m/s in a fully autonomous pipeline using onboard computing.

关键词： Uncertainty Pipelines Logic gates Autonomous aerial vehicles Robustness Motion capture Trajectory

Learning Deep Sensorimotor Policies for vision-Based Autonomous Drone Racing

学校读者我要写书评

暂无评论

Learning Deep Sensorimotor Policies for Vision-Based Autonom...

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Jiawei Fu Yunlong Song Yan Wu Fisher Yu Davide Scaramuzza Department of Informatics Robotics and Perception Group University of Zurich Switzerland Department of Neuroinformatics University of Zurich and ETH Zurich Switzerland Visual Intelligence and Systems Group in the Computer Vision Lab ETH Zurich

The development of effective vision-based algorithms has been a significant challenge in achieving autonomous drones, which promise to offer immense potential for many real-world applications. This paper investigates learning deep sensorimotor policies for vision-based drone racing, which is a particularly demanding setting for testing the limits of an algorithm. Our method combines feature representation learning to extract task-relevant feature representations from high-dimensional image inputs with a learning-by-cheating framework to train a deep sensorimotor policy for vision-based drone racing. This approach eliminates the need for globally-consistent state estimation, trajectory planning, and handcrafted control design, allowing the policy to directly infer control commands from raw images, similar to human pilots. We conduct experiments using a realistic simulator and show that our vision-based policy can achieve state-of-the-art racing performance while being robust against unseen visual disturbances. Our study suggests that consistent feature embeddings are essential for achieving robust control performance in the presence of visual disturbances. The key to acquiring consistent feature embeddings is utilizing contrastive learning along with data augmentation. Video: https://***/AX_fcnW9yqE

关键词：

Traffic Sign Classification Using Deep and Quantum Neural Networks

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Kuros, Sylwia Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Kraków Poland

Quantum Neural Networks (QNNs) are an emerging technology that can be used in many applications including computer vision. In this paper, we presented a traffic sign classification system implemented using a hybrid quantum-classical convolutional neural network. Experiments on the German Traffic Sign Recognition Benchmark dataset indicate that currently QNN do not outperform classical DCNN (Deep Convolutuional Neural Networks), yet still provide an accuracy of over 90% and are a definitely promising solution for advanced computer vision. © 2022, CC BY.

关键词： Traffic signs

Traffic Sign Classification Using Deep and Quantum Neural Networks

学校读者我要写书评

暂无评论

TechRxiv

TechRxiv 2022年

作者： Kuros, Sylwia Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Kraków Poland

关键词： Traffic signs

Absolute Pose from One or Two Scaled and Oriented Features

学校读者我要写书评

暂无评论

Absolute Pose from One or Two Scaled and Oriented Features

Conference on computer vision and Pattern Recognition (CVPR)

作者： Jonathan Ventura Zuzana Kukelova Torsten Sattler Dániel Baráth Department of Computer Science & Software Engineering Cal Poly San Luis Obispo Faculty of Electrical Engineering Visual Recognition Group Czech Technical University in Prague Czech Institute of Informatics Robotics and Cybernetics Czech Technical University in Prague Department of Computer Science Computer Vision and Geometry Group ETH Zürich

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

Keypoints used for image matching often include an estimate of the feature scale and orientation. While recent work has demonstrated the advantages of using feature scales and orientations for relative pose estimation, relatively little work has considered their use for absolute pose estimation. We introduce minimal solutions for absolute pose from two oriented feature correspondences in the general case, or one scaled and oriented correspondence given a known vertical direction. Nowadays, assuming a known direction is not particularly restrictive as modern consumer devices, such as smartphones or drones, are equipped with Inertial Measurement Units (IMU) that provide the gravity direction by default. Compared to traditional absolute pose methods requiring three point correspondences, our solvers need a smaller minimal sample, reducing the cost and complexity of robust estimation. Evaluations on large-scale and public real datasets demonstrate the advantage of our methods for fast and accurate localization in challenging conditions. Code is available at https://***/danini/absolute-pose-from-oriented-and-sealed-features.

关键词： Location awareness Accuracy Simultaneous localization and mapping Measurement units Pose estimation Noise Inertial navigation