检索结果-内蒙古大学图书馆

International Conference on computer Vision and Graphics, ICCVG 2022

作者： Lis, Konrad Kryjak, Tomasz Embedded Vision Systems Group Computer Vision Laboratory Department of Automatic Control and Robotics AGH University of Science and Technology Al. Mickiewicza 30 Krakow30-059 Poland

ISBN: (纸本)9783031220241

3D object detection from LiDAR sensor data is an important topic in the context of autonomous cars and drones. In this paper, we present the results of experiments on the impact of backbone selection of a deep convolutional neural network on detection accuracy and computation speed. We chose the PointPillars network, which is characterised by a simple architecture, high speed, and modularity that allows for easy expansion. During the experiments, we paid particular attention to the change in detection efficiency (measured by the mAP metric) and the total number of multiply-addition operations needed to process one point cloud. We tested 10 different convolutional neural network architectures that are widely used in image-based detection problems. For a backbone like MobilenetV1, we obtained an almost 4x speedup at the cost of a 1.13% decrease in mAP. On the other hand, for CSPDarknet we got an acceleration of more than 1.5x at an increase in mAP of 0.33%. We have thus demonstrated that it is possible to significantly speed up a 3D object detector in LiDAR point clouds with a small decrease in detection efficiency. This result can be used when PointPillars or similar algorithms are implemented in embedded systems, including SoC FPGAs. The code is available at https://***/vision-agh/pointpillars-backbone. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Object detection

来源：评论

学校读者我要写书评

暂无评论

VoroNav: Voronoi-based Zero-shot Object Navigation with Large Language Model 41

VoroNav: Voronoi-based Zero-shot Object Navigation with Larg...

引用

41st International Conference on Machine Learning, ICML 2024

作者： Wu, Pengying Mu, Yao Wu, Bingxian Hou, Yi Ma, Ji Zhang, Shanghang Liu, Chang Department of Advancded Manufacturing and Robotics College of Engineering Peking University Beijing China The University of Hong Kong Hong Kong OpenGVLab Shanghai AI Laboratory China National Key Laboratory for Multimedia Information Processing School of Computer Science Peking University Beijing China

In the realm of household robotics, the Zero-Shot Object Navigation (ZSON) task empowers agents to adeptly traverse unfamiliar environments and locate objects from novel categories without prior explicit training. This paper introduces VoroNav, a novel semantic exploration framework that proposes the Reduced Voronoi Graph to extract exploratory paths and planning nodes from a semantic map constructed in real time. By harnessing topological and semantic information, VoroNav designs text-based descriptions of paths and images that are readily interpretable by a large language model (LLM). In particular, our approach presents a synergy of path and farsight descriptions to represent the environmental context, enabling LLM to apply commonsense reasoning to ascertain waypoints for navigation. Extensive evaluation on HM3D and HSSD validates VoroNav surpasses existing benchmarks in both success rate and exploration efficiency (absolute improvement: +2.8% Success and +3.7% SPL on HM3D, +2.6% Success and +3.8% SPL on HSSD). Additionally introduced metrics that evaluate obstacle avoidance proficiency and perceptual efficiency further corroborate the enhancements achieved by our method in ZSON planning. Copyright 2024 by the author(s)

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Modeling and Control of Intrinsically Elasticity Coupled Soft-Rigid Robots

Modeling and Control of Intrinsically Elasticity Coupled Sof...

引用

IEEE International Conference on robotics and Automation (ICRA)

作者： Zach J. Patterson Cosimo Della Santina Daniela Rus Computer Science and Artificial Intelligence Laboratory MIT Department of Cognitive Robotics Delft University of Technology Institute of Robotics and Mechatronics German Aerospace Center (DLR)

ISBN: (数字)9798350384574

ISBN: (纸本)9798350384581

While much work has been done recently in the realm of model-based control of soft robots and soft-rigid hybrids, most works examine robots that have an inherently serial structure. While these systems have been prevalent in the literature, there is an increasing trend toward designing soft-rigid hybrids with intrinsically coupled elasticity between various degrees of freedom. In this work, we seek to address the issues of modeling and controlling such structures, particularly when underactuated. We introduce several simple models for elastic coupling, typical of those seen in these systems. We then propose a controller that compensates for the elasticity, and we prove its stability with Lyapunov methods without relying on the elastic dominance assumption. This controller is applicable to the general class of underactuated soft robots. After evaluating the controller in simulated cases, we then develop a simple hardware platform to evaluate both the models and the controller. Finally, using the hardware, we demonstrate a novel use case for underactuated, elastically coupled systems in "sensorless" force control.

关键词： Couplings Elasticity Soft robotics Robot sensing systems Market research Hardware Stability analysis

来源：评论

学校读者我要写书评

暂无评论

V3D-SLAM: Robust RGB-D SLAM in Dynamic Environments with 3D Semantic Geometry Voting

V3D-SLAM: Robust RGB-D SLAM in Dynamic Environments with 3D ...

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Tuan Dang Khang Nguyen Manfred Huber Department of Computer Science and Engineering Learning and Adaptive Robotics Laboratory University of Texas at Arlington Arlington TX USA

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Simultaneous localization and mapping (SLAM) in highly dynamic environments is challenging due to the correlation complexity between moving objects and the camera pose. Many methods have been proposed to deal with this problem; however, the moving properties of dynamic objects with a moving camera remain unclear. Therefore, to improve SLAM’s performance, minimizing disruptive events of moving objects with a physical understanding of 3D shapes and dynamics of objects is needed. In this paper, we propose a robust method, V3D-SLAM, to remove moving objects via two lightweight reevaluation stages, including identifying potentially moving and static objects using a spatial-reasoned Hough voting mechanism and refining static objects by detecting dynamic noise caused by intra-object motions using Chamfer distances as similarity measurements. Through our experiment on the TUM RGB-D benchmark on dynamic sequences with ground-truth camera trajectories, the results show that our methods outperform most other recent state-of-the-art SLAM methods. Our source code is available at https://***/tuantdang/v3d-slam.

关键词： Simultaneous localization and mapping Three-dimensional displays Source coding Dynamics Noise Benchmark testing Cameras Feature extraction Trajectory Object recognition

来源：评论

学校读者我要写书评

暂无评论

Volumetric Mapping with Panoptic Refinement using Kernel Density Estimation for Mobile Robots

Volumetric Mapping with Panoptic Refinement using Kernel Den...

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Khang Nguyen Tuan Dang Manfred Huber Department of Computer Science and Engineering Learning and Adaptive Robotics Laboratory University of Texas at Arlington Arlington TX USA

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Reconstructing three-dimensional (3D) scenes with semantic understanding is vital in many robotic applications. Robots need to identify which objects, along with their positions and shapes, to manipulate them precisely with given tasks. Mobile robots, especially, usually use lightweight networks to segment objects on RGB images and then localize them via depth maps; however, they often encounter out-of-distribution scenarios where masks over-cover the objects. In this paper, we address the problem of panoptic segmentation quality in 3D scene reconstruction by refining segmentation errors using non-parametric statistical methods. To enhance mask precision, we map the predicted masks into a depth frame to estimate their distribution via kernel densities. The outliers in depth perception are then rejected without the need for additional parameters in an adaptive manner to out-of-distribution scenarios, followed by 3D reconstruction using projective signed distance functions (SDFs). We validate our method on a synthetic dataset, which shows improvements in both quantitative and qualitative results for panoptic mapping. Through real-world testing, the results furthermore show our method’s capability to be deployed on a real-robot system. Our source code is available at: https://***/mkhangg/refined_panoptic_mapping.

关键词： Image segmentation Three-dimensional displays Statistical analysis Source coding Semantics Mobile robots Kernel Image reconstruction Testing Synthetic data

来源：评论

学校读者我要写书评

暂无评论

A Survey of Human Action Recognition and Posture Prediction

引用

Tsinghua science and Technology 2022年第6期27卷 973-1001页

作者： Nan Ma Zhixuan Wu Yiu-ming Cheung Yuchen Guo Yue Gao Jiahong Li Beiyan Jiang Beijing Key Laboratory of Information Service Engineering the College of RoboticsBeijing Union UniversityBeijing 100101China Department of Computer Science Hong Kong Baptist UniversityHong Kong 999077China Beijing National Research Center for Information Science and Technology Tsinghua UniversityBeijing 100084China School of Software Tsinghua UniversityBeijing 100084China College of Robotics Beijing Union UniversityBeijing 100101China

Human action recognition and posture prediction aim to recognize and predict respectively the action and postures of persons in *** are both active research topics in computer vision community,which have attracted considerable attention from academia and *** are also the precondition for intelligent interaction and human-computer cooperation,and they help the machine perceive the external *** the past decade,tremendous progress has been made in the field,especially after the emergence of deep learning ***,it is necessary to make a comprehensive review of recent *** this paper,firstly,we attempt to present the background,and then discuss research ***,we introduce datasets,various typical feature representation methods,and explore advanced human action recognition and posture prediction ***,facing the challenges in the field,this paper puts forward the research focus,and introduces the importance of action recognition and posture prediction by taking interactive cognition in self-driving vehicle as an example.

关键词： human action recognition posture prediction computer vision human-computer cooperation interactive cognition

来源：评论

学校读者我要写书评

暂无评论

Variable-Speed Dubins Orienteering Problem

Variable-Speed Dubins Orienteering Problem

引用

IEEE Latin American robotics Symposium, LARS

作者： L. C. Vinícius Faria C. G. Caio Ribeiro Douglas G. Macharet Department of Computer Science Computer Vision and Robotics Laboratory (VeRLab) Universidade Federal de Minas Gerais Belo Horizonte MG Brazil

ISBN: (数字)9798331508807

ISBN: (纸本)9798331508814

The class of vehicle routing problems plays an important role in optimizing logistics and transportation strategies across various sectors. In this context, the Orienteering Problem (OP) seeks to determine an optimized path through a set of locations with associated rewards, aiming to maximize the total collected reward while respecting constraints such as time or distance limits. Nonholonomic motion planning, particularly considering Dubins vehicles, is crucial in real-world applications due to its ability to accurately capture the constraints and dynamics of many physical vehicles. In this paper, we extend the Dubins Orienteering Problem (DOP), where unlike the classical Dubins model with constant speed, the vehicle can vary its speed during navigation, enabling the discovery of more effective paths. Experiments comparing both the DOP and our novel formulation show that the VS-DOP achieves higher total collected rewards within the same budget compared to the conventional DOP.

关键词： Navigation Vehicle routing Dynamics Transportation Planning Time factors Vehicle dynamics Robots Logistics

来源：评论

学校读者我要写书评

暂无评论

Entropy-Guided Reinforced Open World Active 3D Object Detection Learning

Entropy-Guided Reinforced Open World Active 3D Object Detect...

引用

2024 China Automation Congress, CAC 2024

作者： Zhang, Haozhe Ma, Liyan Ying, Shihui Institute of Artificial Intelligence Shanghai University Shanghai200444 China School of Computer Engineering and Science School of Mechatronic Engineering and Automation Shanghai Key Laboratory of Intelligent Manufacturing and Robotics Shanghai University Shanghai200444 China Department of Mathematics School of Science Shanghai University Shanghai200444 China

ISBN: (纸本)9798350368604

Traditional fully annotated closed set 3D object detection methods improve model performance but are impractical in real-world settings due to the emergence of new categories and the complexity of 3D annotations. Open-World Object Detection (OWOD) addresses these issues but relies heavily on manual labeling, which is costly. This paper focuses on open world active learning and proposes an entropy-guided reinforced open world active 3D object detection (EROA). EROA regards active learning as a reinforcement learning problem tailored for open driving scenarios. We use entropy as a reward metric for efficient reinforcement learning. We also leverage knowledge from the 2D domain using object-level large-scale vision-language models to enhance sample selection. Extensive experiments evidence that the proposed EROA meets the dynamic and cost-sensitive requirements of autonomous driving, enabling real-time detection of both known and unknown objects. © 2024 IEEE.

关键词： Active learning

来源：评论

学校读者我要写书评

暂无评论

M3ED: Multi-Robot, Multi-Sensor, Multi-Environment Event Dataset

M3ED: Multi-Robot, Multi-Sensor, Multi-Environment Event Dat...

引用

2023 IEEE/CVF Conference on computer Vision and Pattern Recognition Workshops, CVPRW 2023

作者： Chaney, Kenneth Cladera, Fernando Wang, Ziyun Bisulco, Anthony Hsieh, M. Ani Korpela, Christopher Kumar, Vijay Taylor, Camillo J. Daniilidis, Kostas University of Pennsylvania GRASP Laboratory PA19104 United States Robotics Research Center Department of Electrical Engineering and Computer Science United States Military Academy West PointNY10996 United States

ISBN: (纸本)9798350302493

We present M3ED, the first multi-sensor event camera dataset focused on high-speed dynamic motions in robotics applications. M3ED provides high-quality synchronized and labeled data from multiple platforms, including ground vehicles, legged robots, and aerial robots, operating in challenging conditions such as driving along off-road trails, navigating through dense forests, and performing aggressive flight maneuvers. Our dataset also covers demanding operational scenarios for event cameras, such as scenes with high egomotion and multiple independently moving objects. The sensor suite used to collect M3ED includes high-resolution stereo event cameras (1280×720), grayscale imagers, an RGB imager, a high-quality IMU, a 64-beam LiDAR, and RTK localization. This dataset aims to accelerate the development of event-based algorithms and methods for edge cases encountered by autonomous systems in dynamic environments. © 2023 IEEE.

关键词： Cameras

来源：评论

学校读者我要写书评

暂无评论

MechTac: A Multifunctional Tendon-Linked Optical Tactile Sensor for In/Out-the-Field-of-View Perception with Deep Learning 49

MechTac: A Multifunctional Tendon-Linked Optical Tactile Sen...

引用

49th Annual Conference of the IEEE Industrial Electronics Society, IECON 2023

作者： Lu, Zhenyu Yue, Tianqi Zhao, Zhou Si, Weiyong Wang, Ning Yang, Chenguang University of the West of England Bristol Robotics Laboratory Bristol United Kingdom University of Bristol Department of Engineering Mathematics Bristol United Kingdom School of Computer Science Central China Normal University Wuhan China

ISBN: (纸本)9798350331820

Tactile sensors can be used for motion detection and object perception in robot manipulation. The contact detection within the camera's visual inspection area has been well-developed, but perception outside the field of view of the camera is overlooked. In this paper, we present a new tendon-linked tactile sensor, MechTac, to achieve perceptions inside and outside the field of view. The MechTac is an evolution of the typical TacTip sensor with the following two advantages. 1) The ability to provide perception outside the field of view. This is achieved by using a network of braided tendons to transfer deformation from the blind perception regions (TacSide) to the visual areas (TacTip). 2) The tactility of the TacSide and TacTip is reflected by the movements of multiple papillae pins and visible markers on the pin tips on the inner surface of the TacTip. The pins and markers are differentially sensitive to various touch features, which is similar to the differentiated perceptual ability of humans. TacTip is more sensitive to small touches, corresponding to the fingertip, while the TacSide is less sensitive but has a larger perceptual area, corresponding to the middle part of the finger. Moreover, we propose a new deep learning method to decompose the mixed information affected by the TacSide and the TacTip. A modified DenseNet121 was specifically designed for object perception at the TacTip and localization at the TacSide. The experimental results show that prediction accuracy reaches about 98% for object perception or localization and over 99% for the case requiring two functions. © 2023 IEEE.

关键词： Cameras

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：