检索结果-内蒙古大学图书馆

Caging Complex Objects with Geodesic Balls

学校读者我要写书评

暂无评论

Caging Complex Objects with Geodesic Balls

IEEE/RSJ International Conference on Intelligent Robots and Systems

作者： Dmitry Zarubin Florian T. Pokorny Marc Toussaint Danica Kragic Machine Learning and Robotics Lab Universitat Stuttgart Stuttgart Germany Centre for Autonomous Systems Computer Vision and Active Perception Lab School of Computer Science and Communication KTH Royal Institute of Technology Stockholm Sweden

ISBN: (纸本)9781467363563

This paper proposes a novel approach for the synthesis of grasps of objects whose geometry can be observed only in the presence of noise. We focus in particular on the problem of generating caging grasps with a realistic robot hand simulation and show that our method can generate such grasps even on complex objects. We introduce the idea of using geodesic balls on the object's surface in order to approximate the maximal contact surface between a robotic hand and an object. We define two types of heuristics which extract information from approximate geodesic balls in order to identify areas on an object that can likely be used to generate a caging grasp. Our heuristics are based on two scoring functions. The first uses winding angles measuring how much a geodesic ball on the surface winds around a dominant axis, while the second explores using the total discrete Gaussian curvature of a geodesic ball to rank potential caging postures. We evaluate our approach with respect to variations in hand kinematics, for a selection of complex real-world objects and with respect to its robustness to noise.

关键词： Caging Complex Objects Geodesic Balls Gaussian curvature

Hierarchical human-motion prediction and logic-geometric programming for minimal interference human-robot tasks

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Le, An T. Kratzer, Philipp Hagenmayer, Simon Toussaint, Marc Mainprice, Jim Machine Learning and Robotics Lab University of Stuttgart Germany Max Planck Institute for Intelligent Systems IS-MPI Tübingen/Stuttgart Germany Technische Universität Berlin TUB Germany

In this paper, we tackle the problem of human-robot coordination in sequences of manipulation tasks. Our approach integrates hierarchical human motion prediction with Task and Motion Planning (TAMP). We first devise a hierarchical motion prediction approach by combining Inverse Reinforcement learning and short-term motion prediction using a Recurrent Neural Network. In a second step, we propose a dynamic version of the TAMP algorithm Logic-Geometric Programming (LGP) [1]. Our version of Dynamic LGP, replans periodically to handle the mismatch between the human motion prediction and the actual human behavior. We assess the efficacy of the approach by training the prediction algorithms and testing the framework on the publicly available MoGaze dataset [2]. © 2021, CC BY-NC-ND.

关键词： Computer circuits

Safe Leaf Manipulation for Accurate Shape and Pose Estimation of Occluded Fruits

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Yao, Shaoxiong Pan, Sicong Bennewitz, Maren Hauser, Kris University of Illinois at Urbana-Champaign IL United States Humanoid Robots Lab University of Bonn Germany Lamarr Institute for Machine Learning and Artificial Intelligence The Center for Robotics Bonn Germany

Fruit monitoring plays an important role in crop management, and rising global fruit consumption combined with labor shortages necessitates automated monitoring with robots. However, occlusions from plant foliage often hinder accurate shape and pose estimation. Therefore, we propose an active fruit shape and pose estimation method that physically manipulates occluding leaves to reveal hidden fruits. This paper introduces a framework that plans robot actions to maximize visibility and minimize leaf damage. We developed a novel scene-consistent shape completion technique to improve fruit estimation under heavy occlusion and utilize a perception-driven deformation graph model to predict leaf deformation during planning. Experiments on artificial and real sweet pepper plants demonstrate that our method enables robots to safely move leaves aside, exposing fruits for accurate shape and pose estimation, outperforming baseline methods. Project page: https://***/lmap-ssc/. Copyright © 2024, The Authors. All rights reserved.

关键词： Fruits

Accurate Kinematic Modeling using Autoencoders on Differentiable Joints

学校读者我要写书评

暂无评论

Accurate Kinematic Modeling using Autoencoders on Differenti...

IEEE International Conference on robotics and Automation (ICRA)

作者： Nikolas Wilhelm Sami Haddadin Rainer Burgkart Patrick Van Der Smagt Maximilian Karl Munich Institute of Robotics and Machine Intelligence Technical University of Munich Munich Germany Department of Orthopedics and Sports Orthopedics Klinikum Rechts der Isar School of Medicine Munich Germany Volkswagen Group Machine Learning Research Lab Munich Germany

ISBN: (数字)9798350384574

ISBN: (纸本)9798350384581

In robotics and biomechanics, accurately determining joint parameters and computing the corresponding forward and inverse kinematics are critical yet often challenging tasks, especially when dealing with highly individualized and partly unknown systems. This paper unveils a cutting-edge kinematic optimizer, underpinned by an autoencoder-based architecture, to address these challenges. Utilizing a neural network, our approach simulates inverse kinematics, converting measurement data into joint-specific parameters during encoding, enabling a stable optimization process. These parameters are subsequently processed through a predefined, differentiable forward kinematics model, resulting in a decoded representation of the original data. Beyond offering a comprehensive solution to kinematics challenges, our method also unveils previously unidentified joint parameters. Real experimental data from knee and hand joints validate the optimizer’s efficacy. Additionally, our optimizer is multifunctional: it streamlines the modeling and automation of kinematics and enables a nuanced evaluation of diverse modeling techniques. By assessing the differences in reconstruction losses, we illuminate the merits of each approach. Collectively, this preliminary study signifies advancements in kinematic optimization, with potential applications spanning both biomechanics and robotics.

关键词： Biomechanics Automation Biological system modeling Neural networks Kinematics Computer architecture Encoding

GraspME - Grasp manifold estimator

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Hager, Janik Bauer, Ruben Toussaint, Marc Mainprice, Jim Machine Learning and Robotics Lab IPVS University of Stuttgart Germany Max Planck Institute for Intelligent Systems IS-MPI Tübingen/Stuttgart Germany Technische Universität Berlin TUB Germany

In this paper, we introduce a Grasp Manifold Estimator (GraspME) to detect grasp affordances for objects directly in 2D camera images. To perform manipulation tasks autonomously it is crucial for robots to have such graspability models of the surrounding objects. Grasp manifolds have the advantage of providing continuously infinitely many grasps, which is not the case when using other grasp representations such as predefined grasp points. For instance, this property can be leveraged in motion optimization to define goal sets as implicit surface constraints in the robot configuration space. In this work, we restrict ourselves to the case of estimating possible end-effector positions directly from 2D camera images. To this extend, we define grasp manifolds via a set of keypoints and locate them in images using a Mask R-CNN [1] backbone. Using learned features allows to generalize to different view angle, with potentially noisy images, and objects that were not part of the training set. We rely on simulation data only and perform experiments on simple and complex objects, including unseen ones. Our framework achieves an inference speed of 11.5 fps on a GPU, an average precision for keypoint estimation of 94.5% and a mean pixel distance of only 1.29. This shows that we can estimate the objects very well via bounding boxes and segmentation masks as well as approximate the correct grasp manifold's keypoint coordinates. © 2021, CC BY-NC-ND.

关键词： Cameras

A system for traded control teleoperation of manipulation tasks using intent prediction from hand gestures

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Oh, Yoojin Schäfer, Tim Rüther, Benedikt Toussaint, Marc Mainprice, Jim Machine Learning and Robotics Lab IPVS University of Stuttgart Germany Max Planck Institute for Intelligent Systems MPI-IS Tübingen/Stuttgart Germany Technische Universität Berlin TUB Germany

This paper presents a teleoperation system that includes robot perception and intent prediction from hand gestures. The perception module identifies the objects present in the robot workspace and the intent prediction module which object the user likely wants to grasp. This architecture allows the approach to rely on traded control instead of direct control: we use hand gestures to specify the goal objects for a sequential manipulation task, the robot then autonomously generates a grasping or a retrieving motion using trajectory optimization. The perception module relies on the model-based tracker to precisely track the 6D pose of the objects and makes use of a state of the art learning-based object detection and segmentation method, to initialize the tracker by automatically detecting objects in the scene. Goal objects are identified from user hand gestures using a trained a multi-layer perceptron classifier. After presenting all the components of the system and their empirical evaluation, we present experimental results comparing our pipeline to a direct traded control approach (i.e., one that does not use prediction) which shows that using intent prediction allows to bring down the overall task execution time. © 2021, CC BY-NC-ND.

关键词： Forecasting

Design and Implementation of a Robotic Testbench for Analyzing Pincer Grip Execution in Human Specimen Hands

学校读者我要写书评

暂无评论

Design and Implementation of a Robotic Testbench for Analyzi...

IEEE International Conference on robotics and Automation (ICRA)

作者： Nikolas Wilhelm Claudio Glowalla Sami Haddadin Julian Schote Hannes Höppner Patrick van der Smagt Maximilian Karl Rainer Burgkart Department of Orthopedics and Sports Orthopedics Klinikum Rechts der Isar School of Medicine Munich Germany Munich Institute of Robotics and Machine Intelligence Technical University of Munich Munich Germany Humanoid Robotics Laboratory Berliner Hochschule für Technik Berlin Germany Machine Learning Research Lab Volkswagen Group Munich Germany

ISBN: (数字)9798350384574

ISBN: (纸本)9798350384581

This study presents an innovative test rig engineered to explore the kinematic and viscoelastic characteristics of human specimen hands. The rig features eight force-controlled motors linked to muscle tendons, enabling precise stimulation of hand specimens. Hand movements are monitored through an optical tracking system, while a force-torque sensor quantifies the resultant fingertip loads. Employing this setup, we successfully demonstrated a pincer grip using a cadaver hand and measured both muscle forces and grip strength. Our results reveal a nonlinear relationship between tendon forces and grip strength, which can be modeled by an exponential fit. This investigation serves as a nexus between biomechanical and robotics-focused research, providing critical insights for the advancement of robotic hand actuation and therapeutic interventions.

关键词： Biomechanics Technological innovation Tracking Stimulated emission Biological system modeling Muscles Motors

Deep workpiece region segmentation for bin picking

学校读者我要写书评

暂无评论

arXiv 2019年

作者： Khalid, Muhammad Usman Hager, Janik M. Kraus, Werner Huber, Marco F. Toussaint, Marc Robot and Assistive Systems Fraunhofer IPA Stuttgart Germany Machine Learning & Robotics Lab University of Stuttgart Germany Fraunhofer IPA Stuttgart and Institute of Industrial Manufacturing and Management IFF University of Stuttgart Germany

For most industrial bin picking solutions, the pose of a workpiece is localized by matching a CAD model to point cloud obtained from 3D sensor. Distinguishing flat workpieces from bottom of the bin in point cloud imposes challenges in the localization of workpieces that lead to wrong or phantom detections. In this paper, we propose a framework that solves this problem by automatically segmenting workpiece regions from non-workpiece regions in a point cloud data. It is done in real time by applying a fully convolutional neural network trained on both simulated and real data. The real data has been labelled by our novel technique which automatically generates ground truth labels for real point clouds. Along with real time workpiece segmentation, our framework also helps in improving the number of detected workpieces and estimating the correct object poses. Moreover, it decreases the computation time by approximately 1s due to a reduction of the search space for the object pose estimation. Copyright © 2019, The Authors. All rights reserved.

关键词： Chemical detection

Simulation and HRI recent perspectives with the MORSE simulator

学校读者我要写书评

暂无评论

Lecture Notes in Computer Science (including subseries Lectu...

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 2014年 8810卷 13-24页

作者： Lemaignan, Séverin Hanheide, Marc Karg, Michael Khambhaita, Harmish Kunze, Lars Lier, Florian Lütkebohle, Ingo Milliez, Grégoire CHILI Lab. EPFL Lausanne Switzerland Centre for Autonomous Systems University of Lincoln United Kingdom IAS Technische Universität München Germany LAAS/CNRS Université de Toulouse France Intelligent Robotics Lab. University of Birmingham United Kingdom CITEC Bielefeld University Germany Machine Learning and Robotics Lab. Universität Stuttgart Germany

Simulation in robotics is often a love-hate relationship: while simulators do save us a lot of time and effort compared to regular deployment of complex software architectures on complex hardware, simulators are also known to evade many of the real issues that robots need to manage when they enter the real world. Because humans are the paragon of dynamic, unpredictable, complex, real world entities, simulation of human-robot interactions may look condemn to fail, or, in the best case, to be mostly useless. This collective article reports on five independent applications of the MORSE simulator in the field of human-robot interaction: It appears that simulation is already useful, if not essential, to successfully carry out research in the field of HRI, and sometimes in scenarios we do not anticipate. © 2014 Springer International Publishing Switzerland.

关键词： Simulators