检索结果-内蒙古大学图书馆

GO-VMP: Global Optimization for View Motion Planning in Fruit Mapping

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Jose, Allen Isaac Pan, Sicong Zaenker, Tobias Menon, Rohit Houben, Sebastian Bennewitz, Maren Bonn-Rhein-Sieg University of Applied Sciences Germany Humanoid Robots Lab University of Bonn Germany Fraunhofer Institute for Intelligent Analysis and Information Systems Germany Humanoid Robots Lab University of Bonn Lamarr Institute for Machine Learning and Artificial Intelligence Center for Robotics University of Bonn Germany

Automating labor-intensive tasks such as crop monitoring with robots is essential for enhancing production and conserving resources. However, autonomously monitoring horticulture crops remains challenging due to their complex structures, which often result in fruit occlusions. Existing view planning methods attempt to reduce occlusions but either struggle to achieve adequate coverage or incur high robot motion costs. We introduce a global optimization approach for view motion planning that aims to minimize robot motion costs while maximizing fruit coverage. To this end, we leverage coverage constraints derived from the set covering problem (SCP) within a shortest Hamiltonian path problem (SHPP) formulation. While both SCP and SHPP are well-established, their tailored integration enables a unified framework that computes a global view path with minimized motion while ensuring full coverage of selected targets. Given the NP-hard nature of the problem, we employ a region-prior-based selection of coverage targets and a sparse graph structure to achieve effective optimization outcomes within a limited time. Experiments in simulation demonstrate that our method detects more fruits, enhances surface coverage, and achieves higher volume accuracy than the motion-efficient baseline with a moderate increase in motion cost, while significantly reducing motion costs compared to the coverage-focused baseline. Real-world experiments further confirm the practical applicability of our approach. Copyright © 2025, The Authors. All rights reserved.

关键词： Fruits

HortiBot: An Adaptive Multi-Arm System for Robotic Horticulture of Sweet Peppers

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Lenz, Christian Menon, Rohit Schreiber, Michael Jacob, Melvin Paul Behnke, Sven Bennewitz, Maren Autonomous Intelligent Systems Lab University of Bonn Germany Humanoid Robots Lab University of Bonn Germany Center for Robotics Bonn Germany The Lamarr Institute Bonn Germany

Horticultural tasks such as pruning and selective harvesting are labor intensive and horticultural staff are hard to find. Automating these tasks is challenging due to the semi-structured greenhouse workspaces, changing environmental conditions such as lighting, dense plant growth with many occlusions, and the need for gentle manipulation of non-rigid plant organs. In this work, we present the three-armed system HortiBot, with two arms for manipulation and a third arm as an articulated head for active perception using stereo cameras. Its perception system detects not only peppers, but also peduncles and stems in real time, and performs online data association to build a world model of pepper plants. Collision-aware online trajectory generation allows all three arms to safely track their respective targets for observation, grasping, and cutting. We integrated perception and manipulation to perform selective harvesting of peppers and evaluated the system in lab experiments. Using active perception coupled with end-effector force torque sensing for compliant manipulation, HortiBot achieves high success rates in our indoor pepper plant mock-up. Copyright © 2024, The Authors. All rights reserved.

关键词： End effectors

HortiBot: An Adaptive Multi-Arm System for Robotic Horticulture of Sweet Peppers

学校读者我要写书评

暂无评论

HortiBot: An Adaptive Multi-Arm System for Robotic Horticult...

IEEE/RSJ International Conference on Intelligent robots and Systems (IROS)

作者： Christian Lenz Rohit Menon Michael Schreiber Melvin Paul Jacob Sven Behnke Maren Bennewitz Autonomous Intelligent Systems Lab University of Bonn Germany Center for Robotics Bonn Germany Humanoid Robots Lab University of Bonn Germany The Lamarr Institute Bonn Germany

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

关键词： Torque Target tracking Horticulture Active perception Lighting Robot sensing systems Real-time systems Trajectory Sensors Intelligent robots

Compact Multi-Object Placement Using Adjacency-Aware Reinforcement Learning

学校读者我要写书评

暂无评论

Compact Multi-Object Placement Using Adjacency-Aware Reinfor...

IEEE-RAS International Conference on humanoid robots

作者： Benedikt Kreis Nils Dengler Jorge de Heuvel Rohit Menon Hamsa Perur Maren Bennewitz Humanoid Robots Lab University of Bonn Germany Center for Robotics University of Bonn Germany 3Lamarr Institute for ML and AI Bonn Germany

ISBN: (数字)9798350373578

ISBN: (纸本)9798350373585

Close and precise placement of irregularly shaped objects requires a skilled robotic system. The manipulation of objects that have sensitive top surfaces and a fixed set of neighbors is particularly challenging. To avoid damaging the surface, the robot has to grasp them from the side, and during placement, it has to maintain the spatial relations with adjacent objects, while considering the physical gripper extent. In this work, we propose a framework to learn an agent based on reinforcement learning that generates end-effector motions for placing objects as closely as possible to one another. During the placement, our agent considers the spatial constraints with neighbors defined in a given layout of the objects while avoiding collisions. Our approach learns to place compact object assemblies without the need for predefined spacing between objects, as required by traditional methods. We thoroughly evaluated our approach using a two-finger gripper mounted on a robotic arm with six degrees of freedom. The results demonstrate that our agent significantly outperforms two baseline approaches in object assembly compactness, thereby reducing the space required to position the objects while adhering to specified spatial constraints.

关键词： Learning systems Layout Fingers humanoid robots Reinforcement learning Robot sensing systems End effectors Grippers Collision avoidance Assembly

DogLegs: Robust Proprioceptive State Estimation for Legged robots Using Multiple Leg-Mounted IMUs

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Wu, Yibin Kuang, Jian Khorshidi, Shahram Niu, Xiaoji Klingbeil, Lasse Bennewitz, Maren Kuhlmann, Heiner Center for Robotics University of Bonn Germany Institute of Geodesy and Geoinformation University of Bonn Germany Humanoid Robots Lab University of Bonn Germany GNSS Research Center Wuhan University China

Robust and accurate proprioceptive state estimation of the main body is crucial for legged robots to execute tasks in extreme environments where exteroceptive sensors, such as LiDARs and cameras may become unreliable. In this paper, we propose DogLegs, a state estimation system for legged robots that fuses the measurements from a body-mounted inertial measurement unit (Body-IMU), joint encoders, and multiple leg-mounted IMUs (Leg-IMU) using an extended Kalman filter (EKF). The filter system contains the error states of all IMU frames. The Leg-IMUs are used to detect foot contact, thereby providing zero velocity measurements to update the state of the Leg-IMU frames. Additionally, we compute the relative position constraints between the Body-IMU and Leg-IMUs by the leg kinematics and use them to update the main body state and reduce the error drift of the individual IMU frames. Field experimental results have shown that our proposed system can achieve better state estimation accuracy compared to the traditional leg odometry method (using only Body-IMU and joint encoders) across different terrains. We make our datasets publicly available to benefit the research community. Copyright © 2025, The Authors. All rights reserved.

关键词： Extended Kalman filters

Map Space Belief Prediction for Manipulation-Enhanced Mapping

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Marques, Joao Marcos Correia Dengler, Nils Zaenker, Tobias Mücke, Jesper Wang, Shenlong Bennewitz, Maren Hauser, Kris University of Illinois at Urbana-Champaign IL United States Humanoid Robots Lab University of Bonn Germany The Lamarr Institute Bonn Germany The Center for Robotics University of Bonn Germany

Searching for objects in cluttered environments requires selecting efficient viewpoints and manipulation actions to remove occlusions and reduce uncertainty in object locations, shapes, and categories. In this work, we address the problem of manipulation-enhanced semantic mapping, where a robot has to efficiently identify all objects in a cluttered shelf. Although Partially Observable Markov Decision Processes (POMDPs) are standard for decision-making under uncertainty, representing unstructured interactive worlds remains challenging in this formalism. To tackle this, we define a POMDP whose belief is summarized by a metric-semantic grid map and propose a novel framework that uses neural networks to perform map-space belief updates to reason efficiently and simultaneously about object geometries, locations, categories, occlusions, and manipulation physics. Further, to enable accurate information gain analysis, the learned belief updates should maintain calibrated estimates of uncertainty. Therefore, we propose Calibrated Neural-Accelerated Belief Updates (CNABUs) to learn a belief propagation model that generalizes to novel scenarios and provides confidence-calibrated predictions for unknown areas. Our experiments show that our novel POMDP planner improves map completeness and accuracy over existing methods in challenging simulations and successfully transfers to real-world cluttered shelves in zero-shot fashion. Copyright © 2025, The Authors. All rights reserved.

关键词： Markov processes

Physically-Consistent Parameter Identification of robots in Contact

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Khorshidi, Shahram Dawood, Murad Nederkorn, Benno Bennewitz, Maren Khadiv, Majid Humanoid Robots Lab University of Bonn Germany Lamarr Institute for Machine Learning and Artificial Intelligence the Center for Robotics Bonn Germany Roboverse Reply Munich Germany Germany

Accurate inertial parameter identification is crucial for the simulation and control of robots encountering intermittent contacts with the environment. Classically, robots’ inertial parameters are obtained from CAD models that are not precise (and sometimes not available, e.g., Spot from Boston Dynamics), hence requiring identification. To do that, existing methods require access to contact force measurement, a modality not present in modern quadruped and humanoid robots. This paper presents an alternative technique that utilizes joint current/torque measurements —a standard sensing modality in modern robots— to identify inertial parameters without requiring direct contact force measurements. By projecting the whole-body dynamics into the null space of contact constraints, we eliminate the dependency on contact forces and reformulate the identification problem as a linear matrix inequality that can handle physical and geometrical constraints. We compare our proposed method against a common black-box identification method using a deep neural network and show that incorporating physical consistency significantly improves the sample efficiency and generalizability of the model. Finally, we validate our method on the Spot quadruped robot across various locomotion tasks, showcasing its accuracy and generalizability in real-world scenarios over different gaits. Copyright © 2024, The Authors. All rights reserved.

关键词： Multipurpose robots

Safe Leaf Manipulation for Accurate Shape and Pose Estimation of Occluded Fruits

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Yao, Shaoxiong Pan, Sicong Bennewitz, Maren Hauser, Kris University of Illinois at Urbana-Champaign IL United States Humanoid Robots Lab University of Bonn Germany Lamarr Institute for Machine Learning and Artificial Intelligence The Center for Robotics Bonn Germany

Fruit monitoring plays an important role in crop management, and rising global fruit consumption combined with labor shortages necessitates automated monitoring with robots. However, occlusions from plant foliage often hinder accurate shape and pose estimation. Therefore, we propose an active fruit shape and pose estimation method that physically manipulates occluding leaves to reveal hidden fruits. This paper introduces a framework that plans robot actions to maximize visibility and minimize leaf damage. We developed a novel scene-consistent shape completion technique to improve fruit estimation under heavy occlusion and utilize a perception-driven deformation graph model to predict leaf deformation during planning. Experiments on artificial and real sweet pepper plants demonstrate that our method enables robots to safely move leaves aside, exposing fruits for accurate shape and pose estimation, outperforming baseline methods. Project page: https://***/lmap-ssc/. Copyright © 2024, The Authors. All rights reserved.

关键词： Fruits

Safe Multi-Agent Reinforcement Learning for Behavior-Based Cooperative Navigation

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Dawood, Murad Pan, Sicong Dengler, Nils Zhou, Siqi Schoellig, Angela P. Bennewitz, Maren The Humanoid Robots Lab University of Bonn Germany The Lamarr Institute for Machine Learning and Artificial Intelligence and the Center for Robotics Bonn Germany The Learning Systems and Robotics lab The Technical University of Munich Germany

In this paper, we address the problem of behavior-based cooperative navigation of mobile robots using safe multi-agent reinforcement learning (MARL). Our work is the first to focus on cooperative navigation without individual reference targets for the robots, using a single target for the formation's centroid. This eliminates the complexities involved in having several path planners to control a team of robots. To ensure safety, our MARL framework uses model predictive control (MPC) to prevent actions that could lead to collisions during training and execution. We demonstrate the effectiveness of our method in simulation and on real robots, achieving safe behavior-based cooperative navigation without using individual reference targets, with zero collisions, and faster target reaching compared to baselines. Finally, we study the impact of MPC safety filters on the learning process, revealing that we achieve faster convergence during training and we show that our approach can be safely deployed on real robots, even during early stages of the training. © 2023, CC0.

关键词： Adversarial machine learning