检索结果-内蒙古大学图书馆

Energy-Efficient Team Orienteering Problem in the Presence of Time-Varying Ocean Currents

学校读者我要写书评

暂无评论

Energy-Efficient Team Orienteering Problem in the Presence o...

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Ariella Mansfield Douglas G. Macharet M. Ani Hsieh GRASP Laboratory University of Pennsylvania Philadelphia USA Department of Computer Science Computer Vision and Robotics Laboratory (VeRLab) Universidade Federal de Minas Gerais MG Brazil

Autonomous Marine Vehicles (AMVs) have gained interest for scientific and commercial applications, including pipeline and algae bloom monitoring, contaminant tracking, and ocean debris removal. The Team Orienteering Problem (TOP) is relevant in this context as Multi-Robot Systems (MRSs) allow for better coverage of the area of interest, simultaneous data collection at different locations, and an increase in the overall robustness and efficiency of the mission. However, route planning for AMVs in dynamic ocean environments is challenging due to the coupling of environmental and vehicle dynamics. We propose a multi-objective formulation that accounts for the trade-offs between visiting multiple task locations and energy consumption by the vehicles subject to a time budget. This work focuses on vehicles that can maintain a constant net speed but can be adapted to vehicles with constant thrust. Different from existing approaches, our method is able to leverage time-varying ocean currents to improve the energy efficiency of resulting routes. We validate our approach experimentally by superimposing ocean flow models with benchmark instances of the TOP.

关键词：

RTAGrasp: Learning Task-Oriented Grasping from Human Videos via Retrieval, Transfer, and Alignment

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Dong, Wenlong Huang, Dehao Liu, Jiangshan Tang, Chao Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

Task-oriented grasping (TOG) is crucial for robots to accomplish manipulation tasks, requiring the determination of TOG positions and directions. Existing methods either rely on costly manual TOG annotations or only extract coarse grasping positions or regions from human demonstrations, limiting their practicality in real-world applications. To address these limitations, we introduce RTAGrasp, a Retrieval, Transfer, and Alignment framework inspired by human grasping strategies. Specifically, our approach first effortlessly constructs a robot memory from human grasping demonstration videos, extracting both TOG position and direction constraints. Then, given a task instruction and a visual observation of the target object, RTAGrasp retrieves the most similar human grasping experience from its memory and leverages semantic matching capabilities of vision foundation models to transfer the TOG constraints to the target object in a training-free manner. Finally, RTAGrasp aligns the transferred TOG constraints with the robot’s action for execution. Evaluations on the public TOG benchmark, TaskGrasp dataset, show the competitive performance of RTAGrasp on both seen and unseen object categories compared to existing baseline methods. Real-world experiments further validate its effectiveness on a robotic arm. Our code, appendix, and video are available at https: //***/view/rtagrasp/home. © 2024, CC BY.

关键词： Robotic arms

Optimizing NeRF-based SLAM with Trajectory Smoothness Constraints

学校读者我要写书评

暂无评论

arXiv 2024年

作者： He, Yicheng Chen, Guangcheng Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

The joint optimization of Neural Radiance Fields (NeRF) and camera trajectories has been widely applied in SLAM tasks due to its superior dense mapping quality and consistency. NeRF-based SLAM learns camera poses using constraints by implicit map representation. A widely observed phenomenon that results from the constraints of this form is jerky and physically unrealistic estimated camera motion, which in turn affects the map quality. To address this deficiency of current NeRF-based SLAM, we propose in this paper TS-SLAM (TS for Trajectory Smoothness). It introduces smoothness constraints on camera trajectories by representing them with uniform cubic B-splines with continuous acceleration that guarantees smooth camera motion. Benefiting from the differentiability and local control properties of B-splines, TS-SLAM can incrementally learn the control points end-to-end using a sliding window paradigm. Additionally, we regularize camera trajectories by exploiting the dynamics prior to further smooth trajectories. Experimental results demonstrate that TS-SLAM achieves superior trajectory accuracy and improves mapping quality versus NeRF-based SLAM that does not employ the above smoothness constraints. © 2024, CC BY.

关键词： Mapping

HPPS: A Hierarchical Progressive Perception System for Luggage Trolley Detection and Localization at Airports

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Sun, Zhirui Zhang, Zhe Zhao, Jieting Ye, Hanjing Wang, Jiankun Shenzhen Key Laboratory of Robotics Perception and Intelligence Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China Jiaxing Research Institute Southern University of Science and Technology Jiaxing China Shenzhen Key Laboratory of Robotics and Computer Vision Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

The robotic autonomous luggage trolley collection system employs robots to gather and transport scattered luggage trolleys at airports. However, existing methods for detecting and locating these luggage trolleys often fail when they are not fully visible. To address this, we introduce the Hierarchical Progressive Perception System (HPPS), which enhances the detection and localization of luggage trolleys under partial occlusion. The HPPS processes the luggage trolley’s position (x, y) and orientation (θ) separately, which requires only RGB images for labeling and training, eliminating the need for 3D coordinates and alignment. The HPPS can accurately determine the position of the luggage trolley with just one well-detected keypoint and estimate the luggage trolley’s orientation when it is partially occluded. Once the luggage trolley’s initial pose is detected, HPPS updates this information continuously to refine its accuracy until the robot begins grasping. The experiments on detection and localization demonstrate that HPPS is more reliable under partial occlusion compared to existing methods. Its effectiveness and robustness have also been confirmed through practical tests in actual luggage trolley collection tasks. A website about this work is available at HPPS. Copyright © 2024, The Authors. All rights reserved.

关键词： robotics

Suturing Tasks Automation Based on Skills Learned from Demonstrations: A Simulation Study

学校读者我要写书评

暂无评论

Suturing Tasks Automation Based on Skills Learned from Demon...

International Symposium on Medical robotics (ISMR)

作者： Haoying Zhou Yiwei Jiang Shang Gao Shiyue Wang Peter Kazanzides Gregory S. Fischer Department of Robotics Engineering Worcester Polytechnic Institute Worcester MA USA Laboratory for Computational Sensing and Robotics Johns Hopkins University Baltimore MD USA Department of Computer Science Johns Hopkins University Baltimore MD USA

ISBN: (数字)9798350377118

ISBN: (纸本)9798350377125

In this work, we develop an open-source surgical simulation environment that includes a realistic model obtained by MRI-scanning a physical phantom, for the purpose of training and evaluating a Learning from Demonstration (LfD) algorithm for autonomous suturing. The LfD algorithm utilizes Dynamic Movement Primitives (DMP) and Locally Weighted Regression (LWR), but focuses on the needle trajectory, rather than the instruments, to obtain better generality with respect to needle grasps. We conduct a user study to collect multiple suturing demonstrations and perform a comprehensive analysis of the ability of the LfD algorithm to generalize from a demonstration at one location in one phantom to different locations in the same phantom and to a different phantom. Our results indicate good generalization, on the order of 91.5%, when learning from more experienced subjects, indicating the need to integrate skill assessment in the future.

关键词： Training Medical robotics Automation Heuristic algorithms Instruments Phantoms Needles

Traffic Sign Detection With Event Cameras and DCNN 25

学校读者我要写书评

暂无评论

Traffic Sign Detection With Event Cameras and DCNN

25th IEEE Signal Processing: Algorithms, Architectures, Arrangements, and Applications, SPA 2022

作者： Wzorek, Piotr Kryjak, Tomasz Embedded Vision Systems Group Agh University of Science and Technology Computer Vision Laboratory Department of Automatic Control and Robotics Kraków Poland Silesian University of Technology Department of Digital Systems Gliwice Poland

ISBN: (数字)9788362065424

ISBN: (纸本)9788362065424

In recent years, event cameras (DVS - Dynamic Vision Sensors) have been used in vision systems as an alternative or supplement to traditional cameras. They are characterised by high dynamic range, high temporal resolution, low latency, and reliable performance in limited lighting conditions - parameters that are particularly important in the context of advanced driver assistance systems (ADAS) and self-driving cars. In this work, we test whether these rather novel sensors can be applied to the popular task of traffic sign detection. To this end, we analyse different representations of the event data: event frame, event frequency, and the exponentially decaying time surface, and apply video frame reconstruction using a deep neural network called FireNet. We use the deep convolutional neural network YOLOv4 as a detector. For particular representations, we obtain a detection accuracy in the range of 86.9-88.9% mAP@0.5. The use of a fusion of the considered representations allows us to obtain a detector with higher accuracy of 89.9% mAP@0.5. In comparison, the detector for the frames reconstructed with FireNet is characterised by an accuracy of 72.67% mAP@0.5. The results obtained illustrate the potential of event cameras in automotive applications, either as standalone sensors or in close cooperation with typical frame-based cameras. © 2022 Division of Signal Processing and Electronic Systems, Poznan University of Technology (DSPES PUT).

关键词： Cameras

LucidGrasp: Robotic Framework for Autonomous Manipulation of laboratory Equipment with Different Degrees of Transparency via 6D Pose Estimation

学校读者我要写书评

暂无评论

LucidGrasp: Robotic Framework for Autonomous Manipulation of...

IEEE International Conference on robotics and Biomimetics

作者： Maria Makarova Daria Trinitatova Qian Liu Dzmitry Tsetserukou Intelligent Space Robotics Laboratory Center for Digital Engineering Skolkovo Institute of Science and Technology (Skoltech) Moscow Russia Department of Computer Science and Technology Dalian University of Technology China

ISBN: (数字)9798331509644

ISBN: (纸本)9798331509651

Many modern robotic systems operate autonomously, however they often lack the ability to accurately analyze the environment and adapt to changing external conditions, while teleoperation systems often require special operator skills. In the field of laboratory automation, the number of automated processes is growing, however such systems are usually developed to perform specific tasks. In addition, many of the objects used in this field are transparent, making it difficult to analyze them using visual channels. The contributions of this work include the development of a robotic framework with autonomous mode for manipulating liquid-filled objects with different degrees of transparency in complex pose combinations. The conducted experiments demonstrated the robustness of the designed visual perception system to accurately estimate object poses for autonomous manipulation, and confirmed the performance of the algorithms in dexterous operations such as liquid dispensing. The proposed robotic framework can be applied for laboratory automation, since it allows solving the problem of performing non-trivial manipulation tasks with the analysis of object poses of varying degrees of transparency and liquid levels, requiring high accuracy and repeatability.

关键词： Visualization Liquids Automation Accuracy Biomimetics Pose estimation Robustness Robots Visual perception

Lumbar spine localisation method based on feature fusion

学校读者我要写书评

暂无评论

CAAI Transactions on Intelligence Technology 2023年第3期8卷 931-945页

作者： Yonghong Zhang Ning Hu Zhuofu Li Xuquan Ji Shanshan Liu Youyang Sha Xiongkang Song Jian Zhang Lei Hu Weishi Li Robotics Institute School of Mechanical Engineering and AutomationBeihang UniversityBeijingChina Beijing Zhuzheng Robot Co. LTDBeijingChina Department of Mechanical Aerospace and Biomedical EngineeringUniversity of TennesseeKnoxvilleTennesseeUSA Department of Orthopaedics Peking University Third HospitalBeijingChina Engineering Research Center of Bone and Joint Precision Medicine Ministry of EducationBeijingChina Beijing Key Laboratory of Spinal Disease Research BeijingChina School of Biological Science and Medical Engineering Beihang UniversityBeijingChina Department of Computer Science University of WarwickCoventryUK

To eliminate unnecessary background information,such as soft tissues in original CT images and the adverse impact of the similarity of adjacent spines on lumbar image segmentation and surgical path planning,a two‐stage approach for localising lumbar segments is ***,based on the multi‐scale feature fusion technology,a non‐linear regression method is used to achieve accurate localisation of the overall spatial region of the lumbar spine,effectively eliminating useless background information,such as soft *** the second stage,we directly realised the precise positioning of each segment in the lumbar spine space region based on the non‐linear regression method,thus effectively eliminating the interference caused by the adjacent *** 3D Intersection over Union(3D_IOU)is used as the main evaluation indicator for the positioning *** an open dataset,3D_IOU values of 0.8339�0.0990 and 0.8559�0.0332 in the first and second stages,respectively is *** addition,the average time required for the proposed method in the two stages is 0.3274 and 0.2105 s ***,the proposed method performs very well in terms of both pre-cision and speed and can effectively improve the accuracy of lumbar image segmentation and the effect of surgical path planning.

关键词： CT image lumbar spatial orientation multi‐scale information fusion

Tac-VGNN: A Voronoi Graph Neural Network for Pose-Based Tactile Servoing

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Fan, Wen Yang, Max Xing, Yifan Lepora, Nathan F. Zhang, Dandan The Department of Engineering Mathematics and Bristol Robotics Laboratory University of Bristol United Kingdom The Department of Computer Science University of Bristol United Kingdom

Tactile pose estimation and tactile servoing are fundamental capabilities of robot touch. Reliable and precise pose estimation can be provided by applying deep learning models to high-resolution optical tactile sensors. Given the recent successes of Graph Neural Network (GNN) and the effectiveness of Voronoi features, we developed a Tactile Voronoi Graph Neural Network (Tac-VGNN) to achieve reliable pose-based tactile servoing relying on a biomimetic optical tactile sensor (TacTip). The GNN is well suited to modeling the distribution relationship between shear motions of the tactile markers, while the Voronoi diagram supplements this with area-based tactile features related to contact depth. The experiment results showed that the Tac-VGNN model can help enhance data interpretability during graph generation and model training efficiency significantly than CNN-based methods. It also improved pose estimation accuracy along vertical depth by 28.57% over vanilla GNN without Voronoi features and achieved better performance on the real surface following tasks with smoother robot control trajectories. For more project details, please view our website: https://***/view/tac-vgnn/home Copyright © 2023, The Authors. All rights reserved.

关键词： Deep learning