检索结果-内蒙古大学图书馆

A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service robotics 23

学校读者我要写书评

暂无评论

A Comparison of Prompt Engineering Techniques for Task Plann...

23rd IEEE-RAS International Conference on Humanoid Robots, Humanoids 2024

作者： Bode, Jonas Pätzold, Bastian Memmesheimer, Raphael Behnke, Sven Computer Science Institute Vi - Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Center for Robotics University of Bonn Autonomous Intelligent Systems group Germany

ISBN: (纸本)9798350373578

Recent advances in Large Language Models (LLMs) have been instrumental in autonomous robot control and human-robot interaction by leveraging their vast general knowledge and capabilities to understand and reason across a wide range of tasks and scenarios. Previous works have investigated various prompt engineering techniques for improving the performance of LLMs to accomplish tasks, while others have proposed methods that utilize LLMs to plan and execute tasks based on the available functionalities of a given robot platform. In this work, we consider both lines of research by comparing prompt engineering techniques and combinations thereof within the application of high-level task planning and execution in service robotics. We define a diverse set of tasks and a simple set of functionalities in simulation, and measure task completion accuracy and execution time for several state-of-the-art models. We make our code, including all prompts, available at https://***/AIS-Bonn/Prompt-Engineering. © 2024 IEEE.

关键词： Human robot interaction

IoT Based Smart Betta Fish Monitoring system with fish fatality prediction. 8

学校读者我要写书评

暂无评论

IoT Based Smart Betta Fish Monitoring system with fish fatal...

8th International Conference for Man Machine systems, ICoMMS 2023

作者： Julida, N.L. Othman, S.M. Ayob, M.N. Rahim, N. Abdul Kanafiah, S.N.A.M. Azmi, M.S. Muhamad Hashim, M.S. Mohamad Talib, M.T.M. Khalid, N.S. Centre of Intelligence for Intelligent Robotics and Autonomous Systems University Malaysia Perlis Malaysia Mechanical Department Faculty of Mechanical Engineering and Technology Universiti Malaysia Perlis Malaysia

This study enlightens the importance of rearing water quality to Betta fish health. A water quality monitoring system was developed based on water quality parameters namely water pH, temperature (°C) and TDS level (ppm). Fuzzy Logic Algorithm was applied to predict the possibility of the fish to get infected by the disease using combination of the water quality parameters value. Graphical User Interface (GUI) was developed to test the efficiency of the fish disease prediction system using fuzzy logic algorithm before the fuzzy rule been embedded to the IOT system. Arduino Uno Wi-Fi R2.0 and Blynk Apps used for enabling the system to update the aquarium water quality to owner in real-time. Hydroponic technology implemented in this project for recirculate rearing water inside the fish tank. Theoretically, the aquaponic system will help regulate the water tank parameters in optimum range and Betta Splendens should be free from all diseases. © Published under licence by IOP Publishing Ltd.

关键词： Fish

RoboCup@Home 2024 OPL Winner NimbRo: Anthropomorphic Service Robots Using Foundation Models for Perception and Planning

学校读者我要写书评

暂无评论

RoboCup@Home 2024 OPL Winner NimbRo: Anthropomorphic Service...

27th RoboCup International Symposium, 2024

作者： Memmesheimer, Raphael Nogga, Jan Pätzold, Bastian Kruzhkov, Evgenii Bultmann, Simon Schreiber, Michael Bode, Jonas Karacora, Bertan Park, Juhui Savinykh, Alena Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI Lamarr Institute for Machine Learning and Artificial Intelligence and Center for Robotics University of Bonn Bonn Germany

ISBN: (纸本)9783031858581

We present the approaches and contributions of the winning team NimbRo@Home at the RoboCup@Home 2024 competition in the Open Platform League held in Eindhoven, NL. Further, we describe our hardware setup and give an overview of the results for the task stages and the final demonstration. For this year’s competition, we put a special emphasis on open-vocabulary object segmentation and grasping approaches that overcome the labeling overhead of supervised vision approaches, commonly used in RoboCup@Home. We successfully demonstrated that we can segment and grasp non-labeled objects by text descriptions. Further, we extensively employed Large Language Model (LLMs) for natural language understanding and task planning. Throughout the competition, our approaches showed robustness and generalization capabilities. A video of our performance can be found online (https://***/videos/RoboCup_2024). © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Robot programming

Object-Centric Image to Video Generation with Language Guidance

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Villar-Corrales, Angel Plepi, Gjergj Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI – Intelligent Systems and Robotics Center for Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Germany

Accurate and flexible world models are crucial for autonomous systems to understand their environment and predict future events. Object-centric models, with structured latent spaces, have shown promise in modeling object dynamics and interactions, but often face challenges in scaling to complex datasets and incorporating external guidance, limiting their applicability in robotics. To address these limitations, we propose TextOCVP, an object-centric model for image-to-video generation guided by textual descriptions. TextOCVP parses an observed scene into object representations, called slots, and utilizes a text-conditioned transformer predictor to forecast future object states and video frames. Our approach jointly models object dynamics and interactions while incorporating textual guidance, thus leading to accurate and controllable predictions. Our method’s structured latent space offers enhanced control over the prediction process, outperforming several image-to-video generative baselines. Additionally, we demonstrate that structured object-centric representations provide superior controllability and interpretability, facilitating the modeling of object dynamics and enabling more precise and understandable predictions. Videos and code are available at https://***/TextOCVP/. © 2025, CC BY.

关键词： Digital elevation model

Towards Conscious Service Robots

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI – Intelligent Systems and Robotics Center for Robotics the Lamarr Institute for Machine Learning and Artificial Intelligence University of Bonn Germany

Deep learning’s success in perception, natural language processing, etc. inspires hopes for advancements in autonomous robotics. However, real-world robotics face challenges like variability, high-dimensional state spaces, non-linear dependencies, and partial observability. A key issue is non-stationarity of robots, environments, and tasks, leading to performance drops with out-of-distribution data. Unlike current machine learning models, humans adapt quickly to changes and new tasks due to a cognitive architecture that enables systematic generalization and meta-cognition. Human brain’s System 1 handles routine tasks unconsciously, while System 2 manages complex tasks consciously, facilitating flexible problem-solving and self-monitoring. For robots to achieve human-like learning and reasoning, they need to integrate causal models, working memory, planning, and metacognitive processing. By incorporating human cognition insights, the next generation of service robots will handle novel situations and monitor themselves to avoid risks and mitigate errors. Copyright © 2025, The Authors. All rights reserved.

关键词： Problem solving

Person Segmentation and Action Classification for Multi-Channel Hemisphere Field of View LiDAR Sensors

学校读者我要写书评

暂无评论

Person Segmentation and Action Classification for Multi-Chan...

IEEE/SICE International Symposium on System Integration

作者： Svetlana Seliunina Artem Otelepko Raphael Memmesheimer Sven Behnke Autonomous Intelligent Systems Group Computer Science Institute VI – Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence and Center for Robotics University of Bonn

ISBN: (数字)9798331531614

ISBN: (纸本)9798331531621

关键词： Reflectivity Adaptation models Laser radar Three-dimensional displays System integration Robot sensing systems Encoding Sensor systems Sensors Safety

LiLMaps: Learnable Implicit Language Maps

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Kruzhkov, Evgenii Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI University of Bonn Germany Autonomous Intelligent Systems Computer Science Institute VI – Intelligent Systems and Robotics Center for Robotics and The Lamarr Institute for Machine Learning and Artificial Intelligence University of Bonn Germany

One of the current trends in robotics is to employ large language models (LLMs) to provide non-predefined command execution and natural human-robot interaction. It is useful to have an environment map together with its language representation, which can be further utilized by LLMs. Such a comprehensive scene representation enables numerous ways of interaction with the map for autonomously operating robots. In this work, we present an approach that enhances incremental implicit mapping through the integration of vision-language features. Specifically, we (i) propose a decoder optimization technique for implicit language maps which can be used when new objects appear on the scene, and (ii) address the problem of inconsistent vision-language predictions between different viewing positions. Our experiments demonstrate the effectiveness of LiLMaps and solid improvements in performance. © 2025, CC BY-NC-ND.

关键词： Visual languages

A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service robotics

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Bode, Jonas Pätzold, Bastian Memmesheimer, Raphael Behnke, Sven The Autonomous Intelligent Systems group Computer Science Institute VI – Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Center for Robotics University of Bonn Germany

关键词： Human robot interaction

A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service robotics

学校读者我要写书评

暂无评论

A Comparison of Prompt Engineering Techniques for Task Plann...

IEEE-RAS International Conference on Humanoid Robots

作者： Jonas Bode Bastian Pätzold Raphael Memmesheimer Sven Behnke Autonomous Intelligent Systems group Computer Science Institute VI – Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence and Center for Robotics University of Bonn Germany

ISBN: (数字)9798350373578

ISBN: (纸本)9798350373585

关键词： Knowledge engineering Service robots Large language models Instruments Humanoid robots Reliability engineering Time measurement Planning Prompt engineering Tuning