检索结果-内蒙古大学图书馆

2025 IEEE/SICE International Symposium on System Integration, SII 2025

作者： Seliunina, Svetlana Otelepko, Artem Memmesheimer, Raphael Behnke, Sven University of Bonn Autonomous Intelligent Systems Group Computer Science Institute VI - Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Center for Robotics Germany

ISBN: (纸本)9798331531614

Robots need to perceive persons in their surroundings for safety and to interact with them. In this paper, we present a person segmentation and action classification approach that operates on 3D scans of hemisphere field of view LiDAR sensors. We recorded a data set with an Ouster OSDome-64 sensor consisting of scenes where persons perform three different actions and annotated it. We propose a method based on a MaskDINO model to detect and segment persons and to recognize their actions from combined spherical projected multi-channel representations of the LiDAR data with an additional positional encoding. Our approach demonstrates good performance for the person segmentation task and further performs well for the estimation of the person action states walking, waving, and sitting. An ablation study provides insights about the individual channel contributions for the person segmentation task. The trained models, code and dataset are made publicly available. © 2025 IEEE.

关键词： Signal encoding

来源：评论

学校读者我要写书评

暂无评论

A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service Robotics 23

A Comparison of Prompt Engineering Techniques for Task Plann...

引用

23rd IEEE-RAS International Conference on Humanoid Robots, Humanoids 2024

作者： Bode, Jonas Pätzold, Bastian Memmesheimer, Raphael Behnke, Sven Computer Science Institute Vi - Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Center for Robotics University of Bonn Autonomous Intelligent Systems group Germany

ISBN: (纸本)9798350373578

Recent advances in Large Language Models (LLMs) have been instrumental in autonomous robot control and human-robot interaction by leveraging their vast general knowledge and capabilities to understand and reason across a wide range of tasks and scenarios. Previous works have investigated various prompt engineering techniques for improving the performance of LLMs to accomplish tasks, while others have proposed methods that utilize LLMs to plan and execute tasks based on the available functionalities of a given robot platform. In this work, we consider both lines of research by comparing prompt engineering techniques and combinations thereof within the application of high-level task planning and execution in service robotics. We define a diverse set of tasks and a simple set of functionalities in simulation, and measure task completion accuracy and execution time for several state-of-the-art models. We make our code, including all prompts, available at https://***/AIS-Bonn/Prompt-Engineering. © 2024 IEEE.

关键词： Human robot interaction

来源：评论

学校读者我要写书评

暂无评论

Sourcerer: Sample-based Maximum Entropy Source Distribution Estimation 38

Sourcerer: Sample-based Maximum Entropy Source Distribution ...

引用

38th Conference on Neural Information Processing systems, NeurIPS 2024

作者： Vetter, Julius Schröder, Cornelius Moss, Guy Gao, Richard Macke, Jakob H. Machine Learning in Science Excellence Cluster Machine Learning University of Tübingen Germany Tübingen AI Center Germany Department Empirical Inference Max Planck Institute for Intelligent Systems Tübingen Germany

Scientific modeling applications often require estimating a distribution of parameters consistent with a dataset of observations-an inference task also known as source distribution estimation. This problem can be ill-posed, however, since many different source distributions might produce the same distribution of data-consistent simulations. To make a principled choice among many equally valid sources, we propose an approach which targets the maximum entropy distribution, i.e., prioritizes retaining as much uncertainty as possible. Our method is purely sample-based-leveraging the Sliced-Wasserstein distance to measure the discrepancy between the dataset and simulations-and thus suitable for simulators with intractable likelihoods. We benchmark our method on several tasks, and show that it can recover source distributions with substantially higher entropy than recent source estimation methods, without sacrificing the fidelity of the simulations. Finally, to demonstrate the utility of our approach, we infer source distributions for parameters of the Hodgkin-Huxley model from experimental datasets with hundreds of single-neuron measurements. In summary, we propose a principled method for inferring source distributions of scientific simulator parameters while retaining as much uncertainty as possible. © 2024 Neural information processing systems foundation. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

RoboCup@Home 2024 OPL Winner NimbRo: Anthropomorphic Service Robots Using Foundation Models for Perception and Planning

RoboCup@Home 2024 OPL Winner NimbRo: Anthropomorphic Service...

引用

27th RoboCup International Symposium, 2024

作者： Memmesheimer, Raphael Nogga, Jan Pätzold, Bastian Kruzhkov, Evgenii Bultmann, Simon Schreiber, Michael Bode, Jonas Karacora, Bertan Park, Juhui Savinykh, Alena Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI Lamarr Institute for Machine Learning and Artificial Intelligence and Center for Robotics University of Bonn Bonn Germany

ISBN: (纸本)9783031858581

We present the approaches and contributions of the winning team NimbRo@Home at the RoboCup@Home 2024 competition in the Open Platform League held in Eindhoven, NL. Further, we describe our hardware setup and give an overview of the results for the task stages and the final demonstration. For this year’s competition, we put a special emphasis on open-vocabulary object segmentation and grasping approaches that overcome the labeling overhead of supervised vision approaches, commonly used in RoboCup@Home. We successfully demonstrated that we can segment and grasp non-labeled objects by text descriptions. Further, we extensively employed Large Language Model (LLMs) for natural language understanding and task planning. Throughout the competition, our approaches showed robustness and generalization capabilities. A video of our performance can be found online (https://***/videos/RoboCup_2024). © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Robot programming

来源：评论

学校读者我要写书评

暂无评论

Latent Diffusion for Neural Spiking Data 38

Latent Diffusion for Neural Spiking Data

引用

38th Conference on Neural Information Processing systems, NeurIPS 2024

作者： Kapoor, Jaivardhan Schulz, Auguste Vetter, Julius Pei, Felix Gao, Richard Macke, Jakob H. Machine Learning in Science University of Tübingen & Tübingen AI Center Tübingen Germany Department Empirical Inference Max Planck Institute for Intelligent Systems Tübingen Germany

Modern datasets in neuroscience enable unprecedented inquiries into the relationship between complex behaviors and the activity of many simultaneously recorded neurons. While latent variable models can successfully extract low-dimensional embeddings from such recordings, using them to generate realistic spiking data, especially in a behavior-dependent manner, still poses a challenge. Here, we present Latent Diffusion for Neural Spiking data (LDNS), a diffusion-based generative model with a low-dimensional latent space: LDNS employs an autoencoder with structured state-space (S4) layers to project discrete high-dimensional spiking data into continuous time-aligned latents. On these inferred latents, we train expressive (conditional) diffusion models, enabling us to sample neural activity with realistic single-neuron and population spiking statistics. We validate LDNS on synthetic data, accurately recovering latent structure, firing rates, and spiking statistics. Next, we demonstrate its flexibility by generating variable-length data that mimics human cortical activity during attempted speech. We show how to equip LDNS with an expressive observation model that accounts for single-neuron dynamics not mediated by the latent state, further increasing the realism of generated samples. Finally, conditional LDNS trained on motor cortical activity during diverse reaching behaviors can generate realistic spiking data given reach direction or unseen reach trajectories. In summary, LDNS simultaneously enables inference of low-dimensional latents and realistic conditional generation of neural spiking datasets, opening up further possibilities for simulating experimentally testable hypotheses. © 2024 Neural information processing systems foundation. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry

LEAP-VO: Long-term Effective Any Point Tracking for Visual O...

引用

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Weirong Chen Le Chen Rui Wang Marc Pollefeys TU Munich Munich Center for Machine Learning MPI for Intelligent Systems Microsoft

ISBN: (数字)9798350353006

ISBN: (纸本)9798350353013

Visual odometry estimates the motion of a moving cam-era based on visual input. Existing methods, mostly focusing on two-view point tracking, often ignore the rich tempo-ral context in the image sequence, thereby overlooking the global motion patterns and providing no assessment of the full trajectory reliability. These shortcomings hinder per-formance in scenarios with occlusion, dynamic objects, and low-texture areas. To address these challenges, we present the Long-term Effective Any Point Tracking (LEAP) mod-ule. LEAP innovatively combines visual, inter-track, and temporal cues with mindfully selected anchors for dynamic track estimation. Moreover, LEAP's temporal probabilistic formulation integrates distribution updates into a learnable iterative refinement module to reason about point-wise un-certainty. Based on these traits, we develop LEAP-VO, a robust visual odometry system adept at handling occlusions and dynamic scenes. Our mindful integration showcases a novel practice by employing long-term point tracking as the front-end. Extensive experiments demonstrate that the pro-posed pipeline significantly outperforms existing baselines across various visual odometry benchmarks.

关键词： Visualization Tracking Dynamics Pipelines Estimation Probabilistic logic Robustness

来源：评论

学校读者我要写书评

暂无评论

Object-Centric Image to Video Generation with Language Guidance

arXiv

引用

arXiv 2025年

作者： Villar-Corrales, Angel Plepi, Gjergj Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI – Intelligent Systems and Robotics Center for Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Germany

Accurate and flexible world models are crucial for autonomous systems to understand their environment and predict future events. Object-centric models, with structured latent spaces, have shown promise in modeling object dynamics and interactions, but often face challenges in scaling to complex datasets and incorporating external guidance, limiting their applicability in robotics. To address these limitations, we propose TextOCVP, an object-centric model for image-to-video generation guided by textual descriptions. TextOCVP parses an observed scene into object representations, called slots, and utilizes a text-conditioned transformer predictor to forecast future object states and video frames. Our approach jointly models object dynamics and interactions while incorporating textual guidance, thus leading to accurate and controllable predictions. Our method’s structured latent space offers enhanced control over the prediction process, outperforming several image-to-video generative baselines. Additionally, we demonstrate that structured object-centric representations provide superior controllability and interpretability, facilitating the modeling of object dynamics and enabling more precise and understandable predictions. Videos and code are available at https://***/TextOCVP/. © 2025, CC BY.

关键词： Digital elevation model

来源：评论

学校读者我要写书评

暂无评论

Towards Conscious Service Robots

arXiv

引用

arXiv 2025年

作者： Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI – Intelligent Systems and Robotics Center for Robotics the Lamarr Institute for Machine Learning and Artificial Intelligence University of Bonn Germany

Deep learning’s success in perception, natural language processing, etc. inspires hopes for advancements in autonomous robotics. However, real-world robotics face challenges like variability, high-dimensional state spaces, non-linear dependencies, and partial observability. A key issue is non-stationarity of robots, environments, and tasks, leading to performance drops with out-of-distribution data. Unlike current machine learning models, humans adapt quickly to changes and new tasks due to a cognitive architecture that enables systematic generalization and meta-cognition. Human brain’s System 1 handles routine tasks unconsciously, while System 2 manages complex tasks consciously, facilitating flexible problem-solving and self-monitoring. For robots to achieve human-like learning and reasoning, they need to integrate causal models, working memory, planning, and metacognitive processing. By incorporating human cognition insights, the next generation of service robots will handle novel situations and monitor themselves to avoid risks and mitigate errors. Copyright © 2025, The Authors. All rights reserved.

关键词： Problem solving

来源：评论

学校读者我要写书评

暂无评论

Person Segmentation and Action Classification for Multi-Channel Hemisphere Field of View LiDAR Sensors

Person Segmentation and Action Classification for Multi-Chan...

引用

IEEE/SICE International Symposium on System Integration

作者： Svetlana Seliunina Artem Otelepko Raphael Memmesheimer Sven Behnke Autonomous Intelligent Systems Group Computer Science Institute VI – Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence and Center for Robotics University of Bonn

ISBN: (数字)9798331531614

ISBN: (纸本)9798331531621

关键词： Reflectivity Adaptation models Laser radar Three-dimensional displays System integration Robot sensing systems Encoding Sensor systems Sensors Safety

来源：评论

学校读者我要写书评

暂无评论

Sourcerer: sample-based maximum entropy source distribution estimation 24

Sourcerer: sample-based maximum entropy source distribution ...

引用

Proceedings of the 38th International Conference on Neural Information Processing systems

作者： Julius Vetter Guy Moss Cornelius Schröder Richard Gao Jakob H. Macke Machine Learning in Science Excellence Cluster Machine Learning University of Tübingen and Tübingen AI Center Machine Learning in Science Excellence Cluster Machine Learning University of Tübingen and Tübingen AI Center and Department Empirical Inference Max Planck Institute for Intelligent Systems Tübingen Germany

ISBN: (纸本)9798331314385

Scientific modeling applications often require estimating a distribution of parameters consistent with a dataset of observations—an inference task also known as source distribution estimation. This problem can be ill-posed, however, since many different source distributions might produce the same distribution of data-consistent simulations. To make a principled choice among many equally valid sources, we propose an approach which targets the maximum entropy distribution, i.e., prioritizes retaining as much uncertainty as possible. Our method is purely sample-based—leveraging the Sliced-Wasserstein distance to measure the discrepancy between the dataset and simulations—and thus suitable for simulators with intractable likelihoods. We benchmark our method on several tasks, and show that it can recover source distributions with substantially higher entropy than recent source estimation methods, without sacrificing the fidelity of the simulations. Finally, to demonstrate the utility of our approach, we infer source distributions for parameters of the Hodgkin-Huxley model from experimental datasets with hundreds of single-neuron measurements. In summary, we propose a principled method for inferring source distributions of scientific simulator parameters while retaining as much uncertainty as possible.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：