检索结果-内蒙古大学图书馆

A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service robotics 23

学校读者我要写书评

暂无评论

A Comparison of Prompt Engineering Techniques for Task Plann...

23rd IEEE-RAS International Conference on Humanoid Robots, Humanoids 2024

作者： Bode, Jonas Pätzold, Bastian Memmesheimer, Raphael Behnke, Sven Computer Science Institute Vi - Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Center for Robotics University of Bonn Autonomous Intelligent Systems group Germany

ISBN: (纸本)9798350373578

Recent advances in Large Language Models (LLMs) have been instrumental in autonomous robot control and human-robot interaction by leveraging their vast general knowledge and capabilities to understand and reason across a wide range of tasks and scenarios. Previous works have investigated various prompt engineering techniques for improving the performance of LLMs to accomplish tasks, while others have proposed methods that utilize LLMs to plan and execute tasks based on the available functionalities of a given robot platform. In this work, we consider both lines of research by comparing prompt engineering techniques and combinations thereof within the application of high-level task planning and execution in service robotics. We define a diverse set of tasks and a simple set of functionalities in simulation, and measure task completion accuracy and execution time for several state-of-the-art models. We make our code, including all prompts, available at https://***/AIS-Bonn/Prompt-Engineering. © 2024 IEEE.

关键词： Human robot interaction

RoboCup@Home 2024 OPL Winner NimbRo: Anthropomorphic Service Robots Using Foundation Models for Perception and Planning

学校读者我要写书评

暂无评论

RoboCup@Home 2024 OPL Winner NimbRo: Anthropomorphic Service...

27th RoboCup International Symposium, 2024

作者： Memmesheimer, Raphael Nogga, Jan Pätzold, Bastian Kruzhkov, Evgenii Bultmann, Simon Schreiber, Michael Bode, Jonas Karacora, Bertan Park, Juhui Savinykh, Alena Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI Lamarr Institute for Machine Learning and Artificial Intelligence and Center for Robotics University of Bonn Bonn Germany

ISBN: (纸本)9783031858581

We present the approaches and contributions of the winning team NimbRo@Home at the RoboCup@Home 2024 competition in the Open Platform League held in Eindhoven, NL. Further, we describe our hardware setup and give an overview of the results for the task stages and the final demonstration. For this year’s competition, we put a special emphasis on open-vocabulary object segmentation and grasping approaches that overcome the labeling overhead of supervised vision approaches, commonly used in RoboCup@Home. We successfully demonstrated that we can segment and grasp non-labeled objects by text descriptions. Further, we extensively employed Large Language Model (LLMs) for natural language understanding and task planning. Throughout the competition, our approaches showed robustness and generalization capabilities. A video of our performance can be found online (https://***/videos/RoboCup_2024). © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Robot programming

LiLMaps: Learnable Implicit Language Maps

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Kruzhkov, Evgenii Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI University of Bonn Germany Autonomous Intelligent Systems Computer Science Institute VI – Intelligent Systems and Robotics Center for Robotics and The Lamarr Institute for Machine Learning and Artificial Intelligence University of Bonn Germany

One of the current trends in robotics is to employ large language models (LLMs) to provide non-predefined command execution and natural human-robot interaction. It is useful to have an environment map together with its language representation, which can be further utilized by LLMs. Such a comprehensive scene representation enables numerous ways of interaction with the map for autonomously operating robots. In this work, we present an approach that enhances incremental implicit mapping through the integration of vision-language features. Specifically, we (i) propose a decoder optimization technique for implicit language maps which can be used when new objects appear on the scene, and (ii) address the problem of inconsistent vision-language predictions between different viewing positions. Our experiments demonstrate the effectiveness of LiLMaps and solid improvements in performance. © 2025, CC BY-NC-ND.

关键词： visual languages

Object-Centric Image to video Generation with Language Guidance

学校读者我要写书评

暂无评论

arXiv 2025年

作者： villar-Corrales, Angel Plepi, Gjergj Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI – Intelligent Systems and Robotics Center for Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Germany

Accurate and flexible world models are crucial for autonomous systems to understand their environment and predict future events. Object-centric models, with structured latent spaces, have shown promise in modeling object dynamics and interactions, but often face challenges in scaling to complex datasets and incorporating external guidance, limiting their applicability in robotics. To address these limitations, we propose TextOCVP, an object-centric model for image-to-video generation guided by textual descriptions. TextOCVP parses an observed scene into object representations, called slots, and utilizes a text-conditioned transformer predictor to forecast future object states and video frames. Our approach jointly models object dynamics and interactions while incorporating textual guidance, thus leading to accurate and controllable predictions. Our method’s structured latent space offers enhanced control over the prediction process, outperforming several image-to-video generative baselines. Additionally, we demonstrate that structured object-centric representations provide superior controllability and interpretability, facilitating the modeling of object dynamics and enabling more precise and understandable predictions. videos and code are available at https://***/TextOCVP/. © 2025, CC BY.

关键词： Digital elevation model

Towards Conscious Service Robots

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI – Intelligent Systems and Robotics Center for Robotics the Lamarr Institute for Machine Learning and Artificial Intelligence University of Bonn Germany

Deep learning’s success in perception, natural language processing, etc. inspires hopes for advancements in autonomous robotics. However, real-world robotics face challenges like variability, high-dimensional state spaces, non-linear dependencies, and partial observability. A key issue is non-stationarity of robots, environments, and tasks, leading to performance drops with out-of-distribution data. Unlike current machine learning models, humans adapt quickly to changes and new tasks due to a cognitive architecture that enables systematic generalization and meta-cognition. Human brain’s System 1 handles routine tasks unconsciously, while System 2 manages complex tasks consciously, facilitating flexible problem-solving and self-monitoring. For robots to achieve human-like learning and reasoning, they need to integrate causal models, working memory, planning, and metacognitive processing. By incorporating human cognition insights, the next generation of service robots will handle novel situations and monitor themselves to avoid risks and mitigate errors. Copyright © 2025, The Authors. All rights reserved.

关键词： Problem solving

Person Segmentation and Action Classification for Multi-Channel Hemisphere Field of view LiDAR Sensors

学校读者我要写书评

暂无评论

Person Segmentation and Action Classification for Multi-Chan...

IEEE/SICE International Symposium on System Integration

作者： Svetlana Seliunina Artem Otelepko Raphael Memmesheimer Sven Behnke Autonomous Intelligent Systems Group Computer Science Institute VI – Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence and Center for Robotics University of Bonn

ISBN: (数字)9798331531614

ISBN: (纸本)9798331531621

关键词： Reflectivity Adaptation models Laser radar Three-dimensional displays System integration Robot sensing systems Encoding Sensor systems Sensors Safety

Hierarchical Pose Estimation and Mapping with Multi-scale Neural Feature Fields

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Kruzhkov, Evgenii Savinykh, Alena Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI University of Bonn Bonn Germany Autonomous Intelligent Systems Computer Science Institute VI – Intelligent Systems and Robotics Center for Robotics Lamarr Institute for Machine Learning and Artificial Intelligence University of Bonn Bonn Germany

Robotic applications require a comprehensive understanding of the scene. In recent years, neural fields-based approaches that parameterize the entire environment have become popular. These approaches are promising due to their continuous nature and their ability to learn scene priors. However, the use of neural fields in robotics becomes challenging when dealing with unknown sensor poses and sequential measurements. This paper focuses on the problem of sensor pose estimation for large-scale neural implicit SLAM. We investigate implicit mapping from a probabilistic perspective and propose hierarchical pose estimation with a corresponding neural network architecture. Our method is well-suited for large-scale implicit map representations. The proposed approach operates on consecutive outdoor LiDAR scans and achieves accurate pose estimation, while maintaining stable mapping quality for both short and long trajectories. We built our method on a structured and sparse implicit representation suitable for large-scale reconstruction and evaluated it using the KITTI and MaiCity datasets. Our approach outperforms the baseline in terms of mapping with unknown poses and achieves state-of-the-art localization accuracy. © 2024, CC BY-NC-ND.

关键词： Mapping

A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service robotics

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Bode, Jonas Pätzold, Bastian Memmesheimer, Raphael Behnke, Sven The Autonomous Intelligent Systems group Computer Science Institute VI – Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Center for Robotics University of Bonn Germany

关键词： Human robot interaction

Self-centering 3-DoF Feet Controller for Hands-Free Locomotion Control in Telepresence and virtual Reality

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Memmesheimer, Raphael Lenz, Christian Schwarz, Max Schreiber, Michael Behnke, Sven The Autonomous Intelligent Systems group Computer Science Institute VI - Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Center for Robotics University of Bonn Germany

We present a novel seated feet controller for handling 3 Degree of Freedom (DoF) aimed to control locomotion for telepresence robotics and virtual reality environments. Tilting the feet on two axes yields in forward, backward and sideways motion. In addition, a separate rotary joint allows for rotation around the vertical axis. Attached springs on all joints self-center the controller. The HTC vive tracker is used to translate the trackers' orientation into locomotion commands. The proposed self-centering feet controller was used successfully for the ANA Avatar XPRIZE competition, where a naive operator traversed the robot through a longer distance, surpassing obstacles while solving various interaction and manipulation tasks in between. We publicly provide the models of the mostly 3D-printed feet controller for reproduction. Copyright © 2024, The Authors. All rights reserved.

关键词： Biped locomotion