检索结果-内蒙古大学图书馆

Person Segmentation and Action Classification for Multi-Channel Hemisphere Field of view LiDAR Sensors

学校读者我要写书评

暂无评论

Person Segmentation and Action Classification for Multi-Chan...

2025 IEEE/SICE International Symposium on System Integration, SII 2025

作者： Seliunina, Svetlana Otelepko, Artem Memmesheimer, Raphael Behnke, Sven University of Bonn Autonomous Intelligent Systems Group Computer Science Institute VI - Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Center for Robotics Germany

ISBN: (纸本)9798331531614

Robots need to perceive persons in their surroundings for safety and to interact with them. In this paper, we present a person segmentation and action classification approach that operates on 3D scans of hemisphere field of view LiDAR sensors. We recorded a data set with an Ouster OSDome-64 sensor consisting of scenes where persons perform three different actions and annotated it. We propose a method based on a MaskDINO model to detect and segment persons and to recognize their actions from combined spherical projected multi-channel representations of the LiDAR data with an additional positional encoding. Our approach demonstrates good performance for the person segmentation task and further performs well for the estimation of the person action states walking, waving, and sitting. An ablation study provides insights about the individual channel contributions for the person segmentation task. The trained models, code and dataset are made publicly available. © 2025 IEEE.

关键词： Signal encoding

A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service Robotics 23

学校读者我要写书评

暂无评论

A Comparison of Prompt Engineering Techniques for Task Plann...

23rd IEEE-RAS International Conference on Humanoid Robots, Humanoids 2024

作者： Bode, Jonas Pätzold, Bastian Memmesheimer, Raphael Behnke, Sven Computer Science Institute Vi - Intelligent Systems and Robotics Lamarr Institute for Machine Learning and Artificial Intelligence Center for Robotics University of Bonn Autonomous Intelligent Systems group Germany

ISBN: (纸本)9798350373578

Recent advances in Large Language Models (LLMs) have been instrumental in autonomous robot control and human-robot interaction by leveraging their vast general knowledge and capabilities to understand and reason across a wide range of tasks and scenarios. Previous works have investigated various prompt engineering techniques for improving the performance of LLMs to accomplish tasks, while others have proposed methods that utilize LLMs to plan and execute tasks based on the available functionalities of a given robot platform. In this work, we consider both lines of research by comparing prompt engineering techniques and combinations thereof within the application of high-level task planning and execution in service robotics. We define a diverse set of tasks and a simple set of functionalities in simulation, and measure task completion accuracy and execution time for several state-of-the-art models. We make our code, including all prompts, available at https://***/AIS-Bonn/Prompt-Engineering. © 2024 IEEE.

关键词： Human robot interaction

RoboCup@Home 2024 OPL Winner NimbRo: Anthropomorphic Service Robots Using Foundation Models for Perception and Planning

学校读者我要写书评

暂无评论

RoboCup@Home 2024 OPL Winner NimbRo: Anthropomorphic Service...

27th RoboCup International Symposium, 2024

作者： Memmesheimer, Raphael Nogga, Jan Pätzold, Bastian Kruzhkov, Evgenii Bultmann, Simon Schreiber, Michael Bode, Jonas Karacora, Bertan Park, Juhui Savinykh, Alena Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI Lamarr Institute for Machine Learning and Artificial Intelligence and Center for Robotics University of Bonn Bonn Germany

ISBN: (纸本)9783031858581

We present the approaches and contributions of the winning team NimbRo@Home at the RoboCup@Home 2024 competition in the Open Platform League held in Eindhoven, NL. Further, we describe our hardware setup and give an overview of the results for the task stages and the final demonstration. For this year’s competition, we put a special emphasis on open-vocabulary object segmentation and grasping approaches that overcome the labeling overhead of supervised vision approaches, commonly used in RoboCup@Home. We successfully demonstrated that we can segment and grasp non-labeled objects by text descriptions. Further, we extensively employed Large Language Model (LLMs) for natural language understanding and task planning. Throughout the competition, our approaches showed robustness and generalization capabilities. A video of our performance can be found online (https://***/videos/RoboCup_2024). © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Robot programming

LIAM: Multimodal Transformer for Language Instructions, Images, Actions and Semantic Maps

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wang, Yihao Memmesheimer, Raphael Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI University of Bonn Germany

The availability of large language models and open-vocabulary object perception methods enables more flexibility for domestic service robots. The large variability of domestic tasks can be addressed without implementing each task individually by providing the robot with a task description along with appropriate environment information. In this work, we propose LIAM — an end-to-end model that predicts action transcripts based on language, image, action, and map inputs. Language and image inputs are encoded with a CLIP backbone, for which we designed two pre-training tasks to fine-tune its weights and pre-align the latent spaces. We evaluate our method on the ALFRED dataset, a simulator-generated benchmark for domestic tasks. Our results demonstrate the importance of pre-aligning embedding spaces from different modalities and the efficacy of incorporating semantic maps. Copyright © 2025, The Authors. All rights reserved.

关键词： Semantics

RoboCup 2023 Humanoid AdultSize Winner NimbRo: NimbRoNet3 visual Perception and Responsive Gait with Waveform In-walk Kicks

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Pavlichenko, Dmytro Ficht, Grzegorz villar-Corrales, Angel Denninger, Luis Brocker, Julia Sinen, Tim Schreiber, Michael Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI University of Bonn Germany

The RoboCup Humanoid League holds annual soccer robot world championships towards the long-term objective of winning against the FIFA world champions by 2050. The participating teams continuously improve their systems. This paper presents the upgrades to our humanoid soccer system, leading our team NimbRo to win the Soccer Tournament in the Humanoid AdultSize League at RoboCup 2023 in Bordeaux, France. The mentioned upgrades consist of: an updated model architecture for visual perception, extended fused angles feedback mechanisms and an additional COM-ZMP controller for walking robustness, and parametric in-walk kicks through waveforms. Copyright © 2024, The Authors. All rights reserved.

关键词： Sports

LiLMaps: Learnable Implicit Language Maps

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Kruzhkov, Evgenii Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI University of Bonn Germany Autonomous Intelligent Systems Computer Science Institute VI – Intelligent Systems and Robotics Center for Robotics and The Lamarr Institute for Machine Learning and Artificial Intelligence University of Bonn Germany

One of the current trends in robotics is to employ large language models (LLMs) to provide non-predefined command execution and natural human-robot interaction. It is useful to have an environment map together with its language representation, which can be further utilized by LLMs. Such a comprehensive scene representation enables numerous ways of interaction with the map for autonomously operating robots. In this work, we present an approach that enhances incremental implicit mapping through the integration of vision-language features. Specifically, we (i) propose a decoder optimization technique for implicit language maps which can be used when new objects appear on the scene, and (ii) address the problem of inconsistent vision-language predictions between different viewing positions. Our experiments demonstrate the effectiveness of LiLMaps and solid improvements in performance. © 2025, CC BY-NC-ND.

关键词： visual languages

Mixed-decomposed convolutional network:A lightweight yet efficient convolutional neural network for ocular disease recognition

学校读者我要写书评

暂无评论

CAAI Transactions on Intelligence Technology 2024年第2期9卷 319-332页

作者： Xiaoqing Zhang Xiao Wu Zunjie Xiao Lingxi Hu Zhongxi Qiu Qingyang Sun Risa Higashita Jiang Liu Research Institute of Trustworthy Autonomous Systems and Department of Computer Science and Engineering Southern University of Science and TechnologyShenzhenChina Tomey Corporation NagoyaJapan Guangdong Provincial Key Laboratory of Brain‐inspired Intelligent Computation Department of Computer Science and EngineeringSouthern University of Science and TechnologyShenzhenChina Singapore Eye Research Institute SingaporeSingapore

Eye health has become a global health concern and attracted broad *** the years,researchers have proposed many state-of-the-art convolutional neural networks(CNNs)to assist ophthalmologists in diagnosing ocular diseases efficiently and ***,most existing methods were dedicated to constructing sophisticated CNNs,inevitably ignoring the trade-off between performance and model *** alleviate this paradox,this paper proposes a lightweight yet efficient network architecture,mixeddecomposed convolutional network(MDNet),to recognise ocular *** MDNet,we introduce a novel mixed-decomposed depthwise convolution method,which takes advantage of depthwise convolution and depthwise dilated convolution operations to capture low-resolution and high-resolution patterns by using fewer computations and fewer *** conduct extensive experiments on the clinical anterior segment optical coherence tomography(AS-OCT),LAG,University of California San Diego,and CIFAR-100 *** results show our MDNet achieves a better trade-off between the performance and model complexity than efficient CNNs including MobileNets and ***,our MDNet outperforms MobileNets by 2.5%of accuracy by using 22%fewer parameters and 30%fewer computations on the AS-OCT dataset.

关键词： artificial intelligence deep learning deep neural networks image analysis image classification medical applications medical image processing

Cybersecurity Landscape on Remote State Estimation:A Comprehensive Review

学校读者我要写书评

暂无评论

IEEE/CAA Journal of Automatica Sinica 2024年第4期11卷 851-865页

作者： Jing Zhou Jun Shang Tongwen Chen the Department of Electrical and Computer Engineering University of AlbertaEdmonton AB T6G 1H9Canada the Department of Control Science and Engineering and Shanghai Research Institute for Intelligent Autonomous Systems Tongji UniversityShanghai 200092China

Cyber-physical systems(CPSs)have emerged as an essential area of research in the last decade,providing a new paradigm for the integration of computational and physical units in modern control *** state estimation(RSE)is an indispensable functional module of ***,it has been demonstrated that malicious agents can manipulate data packets transmitted through unreliable channels of RSE,leading to severe estimation performance *** paper aims to present an overview of recent advances in cyber-attacks and defensive countermeasures,with a specific focus on integrity attacks against ***,two representative frameworks for the synthesis of optimal deception attacks with various performance metrics and stealthiness constraints are discussed,which provide a deeper insight into the vulnerabilities of ***,a detailed review of typical attack detection and resilient estimation algorithms is included,illustrating the latest defensive measures safeguarding RSE from ***,some prevalent attacks impairing the confidentiality and data availability of RSE are examined from both attackers'and defenders'***,several challenges and open problems are presented to inspire further exploration and future research in this field.

关键词： Cyber-attacks Kalman filtering remote state estimation unreliable transmission channels

Hierarchical Pose Estimation and Mapping with Multi-scale Neural Feature Fields

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Kruzhkov, Evgenii Savinykh, Alena Behnke, Sven Autonomous Intelligent Systems Computer Science Institute VI University of Bonn Bonn Germany Autonomous Intelligent Systems Computer Science Institute VI – Intelligent Systems and Robotics Center for Robotics Lamarr Institute for Machine Learning and Artificial Intelligence University of Bonn Bonn Germany

Robotic applications require a comprehensive understanding of the scene. In recent years, neural fields-based approaches that parameterize the entire environment have become popular. These approaches are promising due to their continuous nature and their ability to learn scene priors. However, the use of neural fields in robotics becomes challenging when dealing with unknown sensor poses and sequential measurements. This paper focuses on the problem of sensor pose estimation for large-scale neural implicit SLAM. We investigate implicit mapping from a probabilistic perspective and propose hierarchical pose estimation with a corresponding neural network architecture. Our method is well-suited for large-scale implicit map representations. The proposed approach operates on consecutive outdoor LiDAR scans and achieves accurate pose estimation, while maintaining stable mapping quality for both short and long trajectories. We built our method on a structured and sparse implicit representation suitable for large-scale reconstruction and evaluated it using the KITTI and MaiCity datasets. Our approach outperforms the baseline in terms of mapping with unknown poses and achieves state-of-the-art localization accuracy. © 2024, CC BY-NC-ND.

关键词： Mapping