检索结果-内蒙古大学图书馆

Localization of Inspection Device Along Belt Conveyors With Multiple Branches Using deep Neural Networks

IEEE robotics AND automation LETTERS 2020年第2期5卷 2921-2928页

作者： Yasutomi, Andre Yuji Enoki, Hideo Hitachi Ltd Robot Res Dept Ctr Technol Innovat Mech Engn Res & Dev Grp Hitachinaka Ibaraki 3120034 Japan

Regular inspections of belt conveyors are required to prevent the damage of transported objects. Nevertheless, inspections can be troublesome for belt conveyors composed of a plurality of belt lines with multiple branches. To improve the inspection process, an inspection device composed of an inertial measurement unit (IMU) inside a transported object was introduced in our previous study jointly with an algorithm to detect anomalies in the joints of the belt lines. When belt conveying this device for inspection, however, it is required to not only detect the anomaly but also know its position. This study presents a novel method to estimate the position of the inspection device along the belt conveyor using a deep neural network (DNN). The DNN uses the IMU data to detect seven types of features (passage through five types of joints, device stoppage and regular transport), which, when matched to data on a belt conveyor position database, can correctly be translated into positions. Additionally, the proposed method enables the detection of changes of routes along the belt conveyor that occur when a belt line branches into two output streams. To enhance the DNN feature detections, two original algorithms for DNN output post-processing are also introduced. Experiments with a complex belt conveyor demonstrate this method can successfully detect the position of the inspected device more accurately and more cost-effectively than conventional methods.

关键词： Belts Inspection Prediction algorithms Feature extraction Estimation Databases Neural networks Localization deep learning in robotics and automation maintenance and supply chains manufacturing

来源：评论

学校读者我要写书评

暂无评论

learning to Assemble: Estimating 6D Poses for Robotic Object-Object Manipulation

引用

IEEE robotics AND automation LETTERS 2020年第2期5卷 1159-1166页

作者： Stevsic, Stefan Christen, Sammy Hilliges, Otmar Swiss Fed Inst Technol Dept Comp Sci Adv Interact Technol Lab CH-8092 Zurich Switzerland

In this letter we propose a robotic vision task with the goal of enabling robots to execute complex assembly tasks in unstructured environments using a camera as the primary sensing device. We formulate the task as an instance of 6D pose estimation of template geometries, to which manipulation objects should be connected. In contrast to the standard 6D pose estimation task, this requires reasoning about local geometry that is surrounded by arbitrary context, such as a power outlet embedded into a wall. We propose a deep learning based approach to solve this task alongside a novel dataset that will enable future work in this direction and can serve as a benchmark. We experimentally show that state-of-the-art 6D pose estimation methods alone are not sufficient to solve the task but that our training procedure significantly improves the performance of deep learning techniques in this context.

关键词： deep learning in robotics and automation perception for grasping and manipulation computer vision for automation

来源：评论

学校读者我要写书评

暂无评论

deepGait: Planning and Control of Quadrupedal Gaits Using deep Reinforcement learning

引用

IEEE robotics AND automation LETTERS 2020年第2期5卷 3699-3706页

作者： Tsounis, Vassilios Alge, Mitja Lee, Joonho Farshidian, Farbod Hutter, Marco Swiss Fed Inst Technol Robot Syst Lab CH-8092 Zurich Switzerland

This letter addresses the problem of legged locomotion in non-flat terrain. As legged robots such as quadrupeds are to be deployed in terrains with geometries which are difficult to model and predict, the need arises to equip them with the capability to generalize well to unforeseen situations. In this work, we propose a novel technique for training neural-network policies for terrain-aware locomotion, which combines state-of-the-art methods for model-based motion planning and reinforcement learning. Our approach is centered on formulating Markov decision processes using the evaluation of dynamic feasibility criteria in place of physical simulation. We thus employ policy-gradient methods to independently train policies which respectively plan and execute foothold and base motions in 3D environments using both proprioceptive and exteroceptive measurements. We apply our method within a challenging suite of simulated terrain scenarios which contain features such as narrow bridges, gaps and stepping-stones, and train policies which succeed in locomoting effectively in all cases.

关键词： Planning Foot Legged locomotion Optimization Machine learning Dynamics Legged robots deep learning in robotics and automation motion and path planning

来源：评论

学校读者我要写书评

暂无评论

Geometrically Mappable Image Features

引用

IEEE robotics AND automation LETTERS 2020年第2期5卷 2062-2069页

作者： Thoma, Janine Paudel, Danda Pani Chhatkuli, Ajad Gool, Luc Van ETH Comp Vis Lab CH-8092 Zurich Switzerland Katholieke Univ Leuven B-3000 Leuven Belgium

Vision-based localization of an agent in a map is an important problem in robotics and computer vision. In that context, localization by learning matchable image features is gaining popularity due to recent advances in machine learning. Features that uniquely describe the visual contents of images have a wide range of applications, including image retrieval and understanding. In this work, we propose a method that learns image features targeted for image-retrieval-based localization. Retrieval-based localization has several benefits, such as easy maintenance and quick computation. However, the state-of-the-art features only provide visual similarity scores which do not explicitly reveal the geometric distance between query and retrieved images. Knowing this distance is highly desirable for accurate localization, especially when the reference images are sparsely distributed in the scene. Therefore, we propose a novel loss function for learning image features which are both visually representative and geometrically relatable. This is achieved by guiding the learning process such that the feature and geometric distances between images are directly proportional. In our experiments we show that our features not only offer significantly better localization accuracy, but also allow to estimate the trajectory of a query sequence in absence of the reference images.

关键词： Localization deep learning in robotics and automation mapping

来源：评论

学校读者我要写书评

暂无评论

CorsNet: 3D Point Cloud Registration by deep Neural Network

引用

IEEE robotics AND automation LETTERS 2020年第3期5卷 3960-3966页

作者： Kurobe, Akiyoshi Sekikawa, Yusuke Ishikawa, Kohta Saito, Hideo Keio Univ Dept Sci & Technol Yokohama Kanagawa 2238522 Japan Denso IT Lab Inc Tokyo 1500002 Japan

Point cloud registration is a key problem for robotics and computer vision communities. This represents estimating a rigid transform which aligns one point cloud to another. Iterative closest point (ICP) is a well-known classical method for this problem, yet it generally achieves high alignment only when the source and template point cloud are mostly pre-aligned. If each point cloud is far away or contains a repeating structure, the registration often fails because of being fallen into a local minimum. Recently, inspired by PointNet, several deep learning-based methods have been developed. PointNetLK is a representative approach, which directly optimizes the distance of aggregated features using gradient method by Jacobian. In this paper, we propose a point cloud registration system based on deep learning: CorsNet. Since CorsNet concatenates the local features with the global features and regresses correspondences between point clouds, not directly pose or aggregated features, more useful information is integrated than the conventional approaches. For comparison, we also developed a novel deep learning approach (DirectNet) that directly regresses the pose between point clouds. Through our experiments, we show that CorsNet achieves higher accuracy than not only the classic ICP method, but also the recently proposed learning-based proposal PointNetLK and DirectNet, including on seen and unseen categories.

关键词： Three-dimensional displays Feature extraction Transforms Computer architecture Estimation deep learning Network architecture Computer vision for other robotic applications deep learning in robotics and automation perception for grasping and manipulation

来源：评论

学校读者我要写书评

暂无评论

Low to High Dimensional Modality Hallucination Using Aggregated Fields of View

引用

IEEE robotics AND automation LETTERS 2020年第2期5卷 1983-1990页

作者： Gunasekar, Kausic Qiu, Qiang Yang, Yezhou Arizona State Univ Tempe AZ 85281 USA Duke Univ Durham NC 27708 USA

Real-world robotics systems deal with data from a multitude of modalities, especially for tasks such as navigation and recognition. The performance of those systems can drastically degrade when one or more modalities become inaccessible, due to factors such as sensors' malfunctions or adverse environments. Here, we argue modality hallucination as one effective way to ensure consistent modality availability and thereby reduce unfavorable consequences. While hallucinating data from a modality with richer information, e.g., RGB to depth, has been researched extensively, we investigate the more challenging low-to-high modality hallucination with interesting use cases in robotics and autonomous systems. We present a novel hallucination architecture that aggregates information from multiple fields of view of the local neighborhood to recover the lost information from the extant modality. The process is implemented by capturing a non-linear mapping between the data modalities and the learned mapping is used to aid the extant modality to mitigate the risk posed to the system in the adverse scenarios which involve modality loss. We also conduct extensive classification and segmentation experiments on UWRGBD and NYUD datasets and demonstrate that hallucination allays the negative effects of the modality loss. Implementation and models: https://***/kausic94/Hallucination.

关键词： deep learning in robotics and automation robot safety modality hallucination computer vision for other robotic applications

来源：评论

学校读者我要写书评

暂无评论

Robot Navigation in Crowds by Graph Convolutional Networks With Attention Learned From Human Gaze

引用

IEEE robotics AND automation LETTERS 2020年第2期5卷 2754-2761页

作者： Chen, Yuying Liu, Congcong Shi, Bertram E. Liu, Ming Hong Kong Univ Sci & Technol Dept Elect & Comp Engn Hong Kong Peoples R China

Safe and efficient crowd navigation for mobile robot is a crucial yet challenging task. Previous work has shown the power of deep reinforcement learning frameworks to train efficient policies. However, their performance deteriorates when the crowd size grows. We suggest that this can be addressed by enabling the network to identify and pay attention to the humans in the crowd that are most critical to navigation. We propose a novel network utilizing a graph representation to learn the policy. We first train a graph convolutional network based on human gaze data that accurately predicts human attention to different agents in the crowd as they perform a navigation task based on a top down view of the environment. We incorporate the learned attention into a graph-based reinforcement learning architecture. The proposed attention mechanism enables the assignment of meaningful weightings to the neighbors of the robot, and has the additional benefit of interpretability. Experiments on real-world dense pedestrian datasets with various crowd sizes demonstrate that our model outperforms state-of-art methods, increasing task completion rate by 18.4% and decreasing navigation time by 16.4%.

关键词： Autonomous vehicle navigation deep learning in robotics and automation social human-robot interaction

来源：评论

学校读者我要写书评

暂无评论

Depth Based Semantic Scene Completion With Position Importance Aware Loss

引用

IEEE robotics AND automation LETTERS 2020年第1期5卷 219-226页

作者： Li, Jie Liu, Yu Yuan, Xia Zhao, Chunxia Siegwart, Roland Reid, Ian Cadena, Cesar Nanjing Univ Sci & Technol Sch Comp Sci & Engn Nanjing 210094 Jiangsu Peoples R China Univ Adelaide Sch Comp Sci Adelaide SA 5005 Australia Swiss Fed Inst Technol Autonomous Syst Lab CH-8092 Zurich Switzerland

Semantic scene completion (SSC) refers to the task of inferring the 3D semantic segmentation of a scene while simultaneously completing the 3D shapes. We propose PALNet, a novel hybrid network for SSC based on single depth. PALNet utilizes a two-stream network to extract both 2D and 3D features from multi-stages using fine-grained depth information to efficiently capture the context, as well as the geometric cues of the scene. Current methods for SSC treat all parts of the scene equally causing unnecessary attention to the interior of objects. To address this problem, we propose Position Aware Loss (PA-Loss) which is position importance aware while training the network. Specifically, PA-Loss considers Local Geometric Anisotropy to determine the importance of different positions within the scene. It is beneficial for recovering key details like the boundaries of objects and the corners of the scene. Comprehensive experiments on two benchmark datasets demonstrate the effectiveness of the proposed method and its superior performance. Code and demo Video demo can be found here: https://***/j-LAMcMh0yg. are avaliable at https://***/UniLauX/PALNet.

关键词： Semantic scene understanding deep learning in robotics and automation RGB-D perception

来源：评论

学校读者我要写书评

暂无评论

Motor Synergy Development in High-Performing deep Reinforcement learning Algorithms

引用

IEEE robotics AND automation LETTERS 2020年第2期5卷 1271-1278页

作者： Chai, Jiazheng Hayashibe, Mitsuhiro Tohoku Univ Grad Sch Engn Dept Robot Neurorobot Lab Sendai Miyagi 9808579 Japan

As human motor learning is hypothesized to use the motor synergy concept, we investigate if this concept could also be observed in deep reinforcement learning for robotics. From this point of view, we carried out a joint-space synergy analysis on multi-joint running agents in simulated environments trained using two state-of-the-art deep reinforcement learning algorithms. Although a synergy constraint has never been encoded into the reward function, the synergy emergence phenomenon could be observed statistically in the learning agent. To our knowledge, this is the first attempt to quantify the synergy development in detail and evaluate its emergence process during deep learning motor control tasks. We then demonstrate that there is a correlation between our synergy-related metrics and the performance and energy efficiency of a trained agent. Interestingly, the proposed synergy-related metrics reflected a better learning capability of SAC over TD3. It suggests that these metrics could be additional new indices to evaluate deep reinforcement learning algorithms for motor learning. It also indicates that synergy is required for multi-joints robots to move energy-efficiently.

关键词： deep learning in robotics and automation performance evaluation and benchmarking motor synergy

来源：评论

学校读者我要写书评

暂无评论

learning Densities in Feature Space for Reliable Segmentation of Indoor Scenes

引用

IEEE robotics AND automation LETTERS 2020年第2期5卷 1032-1038页

作者： Marchal, Nicolas Moraldo, Charlotte Blum, Hermann Siegwart, Roland Cadena, Cesar Gawel, Abel Swiss Fed Inst Technol Autonomous Syst Lab CH-8092 Zurich Switzerland

deep learning has enabled remarkable advances in scene understanding, particularly in semantic segmentation tasks. Yet, current state of the art approaches are limited to a closed set of classes, and fail when facing novel elements, also known as out of distribution (OoD) data. This is a problem as autonomous agents will inevitably come across a wide range of objects, all of which cannot be included during training. We propose a novel method to distinguish any object (foreground) from empty building structure (background) in indoor environments. We use normalizing flow to estimate the probability distribution of high-dimensional background descriptors. Foreground objects are therefore detected as areas in an image for which the descriptors are unlikely given the background distribution. As our method does not explicitly learn the representation of individual objects, its performance generalizes well outside of the training examples. Our model results in an innovative solution to reliably segment foreground from background in indoor scenes, which opens the way to a safer deployment of robots in human environments.

关键词： deep learning in robotics and automation Semantic Scene Understanding Visual learning

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：