检索结果-内蒙古大学图书馆

An Interior Point Method Solving Motion Planning Problems with Narrow Passages

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Mainprice, Jim Ratliff, Nathan Toussaint, Marc Schaal, Stefan Machine Learning and Robotics Lab University of Stuttgart Germany Max Planck Institute for Intelligent Systems IS-MPITübingen & Stuttgart Germany Learning and Intelligent Systems Lab TU Berlin Berlin Germany

Algorithmic solutions for the motion planning problem have been investigated for five decades. Since the development of A* in 1969 many approaches have been investigated, traditionally classified as either grid decomposition, potential fields or sampling-based. In this work, we focus on using numerical optimization, which is understudied for solving motion planning problems. This lack of interest in the favor of sampling-based methods is largely due to the non-convexity introduced by narrow passages. We address this shortcoming by grounding the solution in differential geometry. We demonstrate through a series of experiments on 3 Dofs and 6 Dofs narrow passage problems, how modeling explicitly the underlying Riemannian manifold leads to an efficient interior point non-linear programming solution. 1. Copyright © 2020, The Authors. All rights reserved.

关键词： Nonlinear programming

PandaNet: Anchor-Based Single-Shot Multi-Person 3D Pose Estimation

学校读者我要写书评

暂无评论

PandaNet: Anchor-Based Single-Shot Multi-Person 3D Pose Esti...

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Abdallah Benzine Florian Chabot Bertrand Luvison Quoc Cuong Pham Catherine Achard CEA LIST Vision and Learning Lab for Scene Analysis Sorbonne University CNRS Institute for Intelligent Systems and Robotics

ISBN: (数字)9781728171685

ISBN: (纸本)9781728171692

Recently, several deep learning models have been proposed for 3D human pose estimation. Nevertheless, most of these approaches only focus on the single-person case or estimate 3D pose of a few people at high resolution. Furthermore, many applications such as autonomous driving or crowd analysis require pose estimation of a large number of people possibly at low-resolution. In this work, we present PandaNet (Pose estimAtioN and Dectection Anchor-based Network), a new single-shot, anchor-based and multi-person 3D pose estimation approach. The proposed model performs bounding box detection and, for each detected person, 2D and 3D pose regression into a single forward pass. It does not need any post-processing to regroup joints since the network predicts a full 3D pose for each bounding box and allows the pose estimation of a possibly large number of people at low resolution. To manage people overlapping, we introduce a Pose-Aware Anchor Selection strategy. Moreover, as imbalance exists between different people sizes in the image, and joints coordinates have different uncertainties depending on these sizes, we propose a method to automatically optimize weights associated to different people scales and joints for efficient training. PandaNet surpasses previous single-shot methods on several challenging datasets: a multi-person urban virtual but very realistic dataset (JTA Dataset), and two real world 3D multi-person datasets (CMU Panoptic and MuPoTS-3D).

关键词： Three-dimensional displays Two dimensional displays Pose estimation Heating systems Image resolution Solid modeling Skeleton

An Interior Point Method Solving Motion Planning Problems with Narrow Passages

学校读者我要写书评

暂无评论

An Interior Point Method Solving Motion Planning Problems wi...

IEEE International Workshop on Robot and Human Communication (ROMAN)

作者： Jim Mainprice Nathan Ratliff Marc Toussaint Stefan Schaal Machine Learning and Robotics Lab University of Stuttgart Germany Max Planck Institute for Intelligent Systems IS-MPI Tübingen & Stuttgart Germany Learning and Intelligent Systems Lab TU Berlin Berlin Germany

ISBN: (数字)9781728160757

ISBN: (纸本)9781728160764

关键词：

Deep Visual Heuristics: learning Feasibility of Mixed-Integer Programs for Manipulation Planning

学校读者我要写书评

暂无评论

Deep Visual Heuristics: Learning Feasibility of Mixed-Intege...

IEEE International Conference on robotics and Automation (ICRA)

作者： Danny Driess Ozgur Oguz Jung-Su Ha Marc Toussaint Machine Learning and Robotics Lab University of Stuttgart Germany Max Planck Institute for Intelligent Systems Stuttgart Germany

ISBN: (数字)9781728173955

ISBN: (纸本)9781728173962

In this paper, we propose a deep neural network that predicts the feasibility of a mixed-integer program from visual input for robot manipulation planning. Integrating learning into task and motion planning is challenging, since it is unclear how the scene and goals can be encoded as input to the learning algorithm in a way that enables to generalize over a variety of tasks in environments with changing numbers of objects and goals. To achieve this, we propose to encode the scene and the target object directly in the image *** experiments show that our proposed network generalizes to scenes with multiple objects, although during training only two objects are present at the same time. By using the learned network as a heuristic to guide the search over the discrete variables of the mixed-integer program, the number of optimization problems that have to be solved to find a feasible solution or to detect infeasibility can greatly be reduced.

关键词： Planning Task analysis Robot sensing systems Neural networks Grasping Search problems

Anticipating Human Intention for Full-Body Motion Prediction in Object Grasping and Placing Tasks

学校读者我要写书评

暂无评论

Anticipating Human Intention for Full-Body Motion Prediction...

IEEE International Workshop on Robot and Human Communication (ROMAN)

作者： Philipp Kratzer Niteesh Balachandra Midlagajni Marc Toussaint Jim Mainprice Machine Learning and Robotics Lab University of Stuttgart Germany Humans to Robots Motions Research Group HRM University of Stuttgart Germany Learning and Intelligent Systems Lab Technical University of Berlin Germany

ISBN: (数字)9781728160757

ISBN: (纸本)9781728160764

Motion prediction in unstructured environments is a difficult problem and is essential for safe and efficient human-robot space sharing and collaboration. In this work, we focus on manipulation movements in environments such as homes, workplaces or restaurants, where the overall task and environment can be leveraged to produce accurate motion prediction. For these cases we propose an algorithmic framework that accounts explicitly for the environment geometry based on a model of affordances and a model of short-term human dynamics both trained on motion capture data. We propose dedicated function networks for graspability and placebility affordances and we make use of a dedicated RNN [1] for short-term motion prediction. The prediction of grasp and placement probability densities are used by a constraint-based trajectory optimizer to produce a full-body motion prediction over the entire horizon. We show by comparing to ground truth data that we achieve similar performance for full-body motion predictions as using oracle grasp and place locations.

关键词：

Anticipating Human Intention for Full-Body Motion Prediction in Object Grasping and Placing Tasks

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Kratzer, Philipp Midlagajni, Niteesh Balachandra Toussaint, Marc Mainprice, Jim Machine Learning and Robotics Lab University of Stuttgart Germany Humans to Robots Motions Research Group HRM University of Stuttgart Germany Learning and Intelligent Systems Lab Technical University of Berlin Germany

关键词： Motion estimation

Describing Physics For Physical Reasoning: Force-based Sequential Manipulation Planning

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Toussaint, Marc Ha, Jung-Su Driess, Danny Machine Learning & Robotics Lab University Stuttgart Stuttgart70569 Germany Max Planck Institute for Intelligent Systems Stuttgart70569 Germany

Physical reasoning is a core aspect of intelligence in animals and humans. A central question is what model should be used as a basis for reasoning. Existing work considered models ranging from intuitive physics and physical simulators to contact dynamics models used in robotic manipulation and locomotion. In this work we propose path descriptions of physics which directly allow us to leverage optimization methods to solve planning problems, using multi-physics descriptions that enable the solver to mix various levels of abstraction and simplifications for different objects and phases of the solution. We demonstrate the approach on various robot manipulation planning problems, such as grasping a stick in order to push or lift another object to a target, shifting and grasping a book from a shelve, and throwing an object to bounce towards a target. Copyright © 2020, The Authors. All rights reserved.

关键词：

Motion planner augmented reinforcement learning for robot manipulation in obstructed environments

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Yamada, Jun Lee, Youngwoon Salhotra, Gautam Pertsch, Karl Pflueger, Max Sukhatme, Gaurav S. Lim, Joseph J. Englert, Peter Cognitive Learning for Vision and Robotics Lab United States Robotic Embedded Systems Laboratory Department of Computer Science University of Southern California United States

Deep reinforcement learning (RL) agents are able to learn contact-rich manipulation tasks by maximizing a reward signal, but require large amounts of experience, especially in environments with many obstacles that complicate exploration. In contrast, motion planners use explicit models of the agent and environment to plan collision-free paths to faraway goals, but suffer from inaccurate models in tasks that require contacts with the environment. To combine the benefits of both approaches, we propose motion planner augmented RL (MoPA-RL) which augments the action space of an RL agent with the long-horizon planning capabilities of motion planners. Based on the magnitude of the action, our approach smoothly transitions between directly executing the action and invoking a motion planner. We evaluate our approach on various simulated manipulation tasks and compare it to alternative action spaces in terms of learning efficiency and safety. The experiments demonstrate that MoPA-RL increases learning efficiency, leads to a faster exploration, and results in safer policies that avoid collisions with the environment. Videos and code are available at https://***/mopa-rl. Copyright © 2020, The Authors. All rights reserved.

关键词： Motion planning

MoGaze: A dataset of full-body motions that includes workspace geometry and eye-gaze

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Kratzer, Philipp Bihlmaier, Simon Midlagajni, Niteesh Balachandra Prakash, Rohit Toussaint, Marc Mainprice, Jim Machine Learning and Robotics Lab University of Stuttgart Humans to Robots Motions Research Group University of Stuttgart Germany Humans to Robots Motions Research Group University of Stuttgart Germany Learning and Intelligent Systems lab TU Berlin Germany

As robots become more present in open human environments, it will become crucial for robotic systems to understand and predict human motion. Such capabilities depend heavily on the quality and availability of motion capture data. However, existing datasets of full-body motion rarely include 1) long sequences of manipulation tasks, 2) the 3D model of the workspace geometry, and 3) eye-gaze, which are all important when a robot needs to predict the movements of humans in close proximity. Hence, in this paper, we present a novel dataset of full-body motion for everyday manipulation tasks, which includes the above. The motion data was captured using a traditional motion capture system based on reflective markers. We additionally captured eye-gaze using a wearable pupil-tracking device. As we show in experiments, the dataset can be used for the design and evaluation of full-body motion prediction algorithms. Furthermore, our experiments show eye-gaze as a powerful predictor of human intent. The dataset includes 180 min of motion capture data with 1627 pick and place actions being performed. It is available at MoGaze Dataset1 and is planned to be extended to collaborative tasks with two humans in the near future. Copyright © 2020, The Authors. All rights reserved.

关键词： Motion estimation