检索结果-内蒙古大学图书馆

Spherical interpolated convolutional network with distance-feature density for 3D semantic segmentation of point clouds

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Wang, Guangming Yang, Yehui Zhang, Huixin Liu, Zhe Wang, Hesheng Department of Automation Insititue of Medical Robotics Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Jiao Tong University Shanghai200240 China Beijing Advanced Innovation Center for Intelligent Robots and Systems Beijing Institute of Technology China Department of Computer Science and Technology University of Cambridge United Kingdom

The semantic segmentation of point clouds is an important part of the environment perception for robots. However, it is difficult to directly adopt the traditional 3D convolution kernel to extract features from raw 3D point clouds because of the unstructured property of point clouds. In this paper, a spherical interpolated convolution operator is proposed to replace the traditional grid-shaped 3D convolution operator. This newly proposed feature extraction operator improves the accuracy of the network and reduces the parameters of the network. In addition, this paper analyzes the defect of point cloud interpolation methods based on the distance as the interpolation weight and proposes the self-learned distance-feature density by combining the distance and the feature correlation. The proposed method makes the feature extraction of spherical interpolated convolution network more rational and effective. The effectiveness of the proposed network is demonstrated on the 3D semantic segmentation task of point clouds. Experiments show that the proposed method achieves good performance on the ScanNet dataset and Paris-Lille-3D dataset. Copyright © 2020, The Authors. All rights reserved.

关键词： Semantic Segmentation

End-to-End 3D Point Cloud Learning for Registration Task Using Virtual Correspondences

学校读者我要写书评

暂无评论

End-to-End 3D Point Cloud Learning for Registration Task Usi...

2020 IEEE/RSJ International Conference on intelligent Robots and systems (IROS)

作者： Huanshu Wei Zhijian Qiao Zhe Liu Chuanzhe Suo Peng Yin Yueling Shen Haoang Li Hesheng Wang The Chinese University of Hong Kong T Stone Robotics Institute Hong Kong Shanghai Jiao Tong University China University of Cambridge United Kingdom Carnegie Mellon University Insititue of Medical Robotics Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Jiao Tong University Shanghai China Beijing Advanced Innovation Center for Intelligent Robots and Systems Beijing Institute of Technology China

ISBN: (数字)9781728162126

ISBN: (纸本)9781728162133

3D Point cloud registration is still a very challenging topic due to the difficulty in finding the rigid transformation between two point clouds with partial correspondences, and it's even harder in the absence of any initial estimation information. In this paper, we present an end-to-end deep-learning based approach to resolve the point cloud registration problem. Firstly, the revised LPD-Net is introduced to extract features and aggregate them with the graph network. Secondly, the self-attention mechanism is utilized to enhance the structure information in the point cloud and the cross-attention mechanism is designed to enhance the corresponding information between the two input point clouds. Based on which, the virtual corresponding points can be generated by a soft pointer based method, and finally, the point cloud registration problem can be solved by implementing the SVD method. Comparison results in ModelNet40 dataset validate that the proposed approach reaches the state-of-the-art in point cloud registration tasks and experiment resutls in KITTI dataset validate the effectiveness of the proposed approach in real applications.

关键词： Three-dimensional displays Aggregates Pose estimation Feature extraction Task analysis intelligent robots

Social Adaptation of Robots for Modulating Self-Organization in Animal Societies

学校读者我要写书评

暂无评论

Social Adaptation of Robots for Modulating Self-Organization...

IEEE International Conference on Self-Adaptive and Self-Organizing systems Workshops, SASOW

作者： Payam Zahadat Michael Bodi Ziad Salem Frank Bonnet Marcelo Elias De Oliveira Francesco Mondada Karlo Griparic Tomislav Haus Stjepan Bogdan Rob Mills Pedro Mariano Luis Correia Olga Kernbach Serge Kernbach Thomas Schmickl Artificial Life Laboratory of the Department of Zoology Karl-Franzens University Graz Austria Computer Engineering Department Aleppo University Syrian Arab Republic Rbotic Systems Laboratory Swiss Federal Institute of Technology (EPFL) Lausanne Switzerland Ecole Polytechnique Federale de Lausanne Lausanne VD CH Faculty of Electrical Engineering and Computing Laboratory for Robotics and Intelligent Control Systems Zagreb Croatia Universidade de Lisboa Lisboa Lisboa PT Cybertronica Research Research Center of Advanced Robotics and Environmental Science Stuttgart Germany

The goal of the work presented here is to influence the overall behaviour of specific animal societies by integrating computational mechatronic devices (robots) into those societies. To do so, these devices should be accepted by the animals aspart of the society and/or as part of the collectively formed environment. For that, we have developed two sets of robotic hardware for integrating into societies of two different animals: zebra fish and young honeybees. We also developed mechanisms to provide feedback from the behaviours of societies for the controllers of the robotic system. Two different computational methods are then used as the controllers of the robots in simulation and successfully adapted by evolutionary algorithms to influence the simulated animals for desired behaviours. Together, these advances in mechatronic hardware, feedback mechanisms, and controller methodology are laying essential foundations to facilitate experiments on modulating self-organised behaviour in mixed animal -- robot societies.

关键词： Animals Heating Vibrations Robot sensing systems Hardware Biochemistry

Synthesis of Decoherence-Free Modes in Linear Quantum Passive systems via Robust Pole Placement

学校读者我要写书评

暂无评论

Synthesis of Decoherence-Free Modes in Linear Quantum Passiv...

IEEE International Conference on systems, Man and Cybernetics

作者： Zibo Miao Yu Pan Qing Gao Guangdong Key Laboratory of Intelligent Morphing Mechanisms School of Mechanical Engineering and Automation Adaptive Robotics Harbin Institute of Technology Shenzhen China State Key Laboratory of Industrial Control Technology The Institute of Cyber-Systems and Control College of Control Science and Engineering Zhejiang University Hangzhou China The School of Automation Science and Electrical Engineering Beijing Advanced Innovation Center for Big Data and Brain Computing Beihang University Beijing China

ISBN: (数字)9781665410205

ISBN: (纸本)9781665410212

In this paper we extend our previous research on coherent observer-based pole placement approach to study the synthesis of robust decoherence-free (DF) modes for linear quantum passive systems, which is aimed at preservation of quantum information. In particular, DF modes can be generated by placing the poles on the imaginary axis via a coherent feedback design scheme, and these modes can further be simultaneously made robust against perturbations to the system parameters by minimizing the condition number associated with imaginary poles. We develop explicit algebraic conditions for the existence of such a coherent quantum controller, with the corresponding deign procedure provided. Examples are given to illustrate the process of tuning the DF modes towards perfect robustness via the proposed pole placement technique.

关键词： Perturbation methods Design methodology Quantum optics Robustness Feedback control Closed loop systems Tuning Cybernetics

Design of a Novel Autonomous Docking System With a Supporting Robotic Fish

学校读者我要写书评

暂无评论

Design of a Novel Autonomous Docking System With a Supportin...

IEEE International Conference on Real-time Computing and robotics (RCAR)

作者： Huijie Dong Chunyang Zhao Tiezhu Qiao Jian Wang Di Chen Yan Meng Junzhi Yu Ministry of Education Key Laboratory of Advanced Transducers and Intelligent Control System Taiyuan University of Technology Taiyuan China Institute of Automation Laboratory of Cognitive and Decision Intelligence for Complex System Chinese Academy of Sciences Beijing China Department of Advanced Manufacturing and Robotics College of Engineering State Key Laboratory for Turbulence and Complex Systems Peking University Beijing China College of Electronics and Information Engineering Guangdong Ocean University Zhanjiang China

Underwater supporting robots serving as a relay of energy supplements and communication for other underwater equipment are promising for ocean exploration, development, and protection. This paper proposes a novel autonomous docking system centered on a designed supporting robotic fish named ‘CourierFish’. Specifically, CourierFish is capable of docking with a surface dock station for supplying itself and docking with a seafloor platform for supporting equipment in the platform. A visual navigation scheme integrating LED and ArUco markers is presented for accurate localization. The control approach for docking motion is also illustrated. Simulations and aquatic experiments are performed to verify the feasibility of the proposed docking system. The obtained results lay a solid foundation for the construction of various underwater equipment and robot networks.

关键词：

Real-world Robot Reaching Skill Learning Based on Deep Reinforcement Learning

学校读者我要写书评

暂无评论

Real-world Robot Reaching Skill Learning Based on Deep Reinf...

第32届中国控制与决策会议

作者： Naijun Liu Tao Lu Yinghao Cai Rui Wang Shuo Wang State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences University of Chinese Academy of Sciences Guangdong Provincial Key Lab of Robotics and Intelligent System Shenzhen Institutes of Advanced TechnologyChinese Academy of Sciences Center for Excellence in Brain Science and Intelligence Technology of the Chinese Academy of Sciences

Traditional programming method can achieve certain manipulation tasks with the assumption that robot environment is known and ***,with robots gradually applied in more domains,robots often encounter working scenes which are complicated,unpredictable,and *** overcome the limitation of traditional programming method,in this paper,we apply deep reinforcement learning(DRL) method to train robot agent to obtain skill *** policy trained with DRL on real-world robot is time-consuming and costly,we propose a novel and simple learning paradigm with the aim of training physical robot ***,our method train a virtual agent in an simulated environment to reach random target position from random initial ***,virtual agent trajectory sequence obtained with the trained policy,is transformed to real-world robot command with coordinate transformation to control robot performing reaching *** show that the proposed method can obtain self-adaptive reaching policy with low training cost,which is of great benefits for developing intelligent and robust robot manipulation skill system.

关键词： Robot reaching skill learning deep reinforcement learning

NeRF in robotics: A Survey

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Guangming Pan, Lei Peng, Songyou Liu, Shaohui Xu, Chenfeng Miao, Yanzi Zhan, Wei Tomizuka, Masayoshi Pollefeys, Marc Wang, Hesheng The University of Cambridge ETH Zurich Switzerland The Department of Automation Shanghai Jiao Tong University Shanghai200240 China The Key Laboratory of System Control and Information Processing Ministry of Education of China China Engineering Research Center of Intelligent Control for Underground Space Ministry of Education School of Information and Control Engineering Advanced Robotics Research Center China University of Mining and Technology Xuzhou221116 China ETH Zurich Zurich Switzerland Mechanical Systems Control Laboratory University of California Berkeley United States

Meticulous 3D environment representations have been a longstanding goal in computer vision and robotics fields. The recent emergence of neural implicit representations has introduced radical innovation to this field as implicit representations enable numerous capabilities. Among these, the Neural Radiance Field (NeRF) has sparked a trend because of the huge representational advantages, such as simplified mathematical models, compact environment storage, and continuous scene representations. Apart from computer vision, NeRF has also shown tremendous potential in the field of robotics. Thus, we create this survey to provide a comprehensive understanding of NeRF in the field of robotics. By exploring the advantages and limitations of NeRF, as well as its current applications and future potential, we hope to shed light on this promising area of research. Our survey is divided into two main sections: The Application of NeRF in robotics and The Advance of NeRF in robotics, from the perspective of how NeRF enters the field of robotics. In the first section, we introduce and analyze some works that have been or could be used in the field of robotics from the perception and interaction perspectives. In the second section, we show some works related to improving NeRF's own properties, which are essential for deploying NeRF in the field of robotics. In the discussion section of the review, we summarize the existing challenges and provide some valuable future research directions for reference. © 2024, CC BY-NC-ND.

关键词： robotics

A registration-aided domain adaptation network for 3D Point cloud based place recognition

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Qiao, Zhijian Hu, Hanjiang Shi, Weiang Chen, Siyuan Liu, Zhe Wang, Hesheng Department of Automation Insititue of Medical Robotics Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Jiao Tong University Shanghai200240 China Beijing Advanced Innovation Center for Intelligent Robots and Systems Beijing Institute of Technology China Department of Mechanical Engineering Carnegie Mellon University United States Department of Computer Science and Technology University of Cambridge United Kingdom

In the field of large-scale SLAM for autonomous driving and mobile robotics, 3D point cloud based place recognition has aroused significant research interest due to its robustness to changing environments with drastic daytime and weather variance. However, it is time-consuming and effort-costly to obtain high-quality point cloud data for place recognition model training and ground truth for registration in the real world. To this end, a novel registration-aided 3D domain adaptation network for point cloud based place recognition is proposed. A structure-aware registration network is introduced to help to learn features with geometric information and a 6-DoFs pose between two point clouds with partial overlap can be estimated. The model is trained through a synthetic virtual LiDAR dataset through GTA-V with diverse weather and daytime conditions and domain adaptation is implemented to the real-world domain by aligning the global features. Our results outperform state-of-the-art 3D place recognition baselines or achieve comparable on the real-world Oxford RobotCar dataset with the visualization of registration on the virtual dataset. Copyright © 2020, The Authors. All rights reserved.

关键词： Three dimensional computer graphics

Anchor-based spatio-temporal attention 3D convolutional networks for dynamic 3D point cloud sequences

学校读者我要写书评

暂无评论

arXiv 2020年

作者： Wang, Guangming Chen, Muyao Liu, Hanwen Yang, Yehui Liu, Zhe Wang, Hesheng The Department of Automation Institute of Medical Robotics Key Laboratory of System Control and Information Processing Ministry of Education Key Laboratory of Marine Intelligent Equipment System of Ministry of Education Shanghai Jiao Tong University Shanghai200240 China Beijing Advanced Innovation Center for Intelligent Robots and Systems Beijing Institute of Technology China The Department of Computer Science and Engineering Shanghai Jiao Tong University Shanghai200240 China The Department of Computer Science and Technology University of Cambridge

With the rapid development of measurwement technology, LiDAR and depth cameras are widely used in the perception of the 3D environment. Recent learning based methods for robot perception most focus on the image or video, but deep learning methods for dynamic 3D point cloud sequences are underexplored. Therefore, developing efficient and accurate perception method compatible with these advanced instruments is pivotal to autonomous driving and service robots. An Anchor-based Spatio-Temporal Attention 3D Convolution operation (ASTA3DConv) is proposed in this paper to process dynamic 3D point cloud sequences. The proposed convolution operation builds a regular receptive field around each point by setting several virtual anchors around each point. The features of neighborhood points are firstly aggregated to each anchor based on the spatio-temporal attention mechanism. Then, anchor-based 3D convolution is adopted to aggregate these anchors' features to the core points. The proposed method makes better use of the structured information within the local region and learns spatio-temporal embedding features from dynamic 3D point cloud sequences. Anchor-based Spatio-Temporal Attention 3D Convolutional Neural Networks (ASTA3DCNNs) are built for classification and segmentation tasks based on the proposed ASTA3DConv and evaluated on action recognition and semantic segmentation tasks. The experiments and ablation studies on MSRAction3D and Synthia datasets demonstrate the superior performance and effectiveness of our method for dynamic 3D point cloud sequences. Our method achieves the state-of-the-art performance among the methods with dynamic 3D point cloud sequences as input on MSRAction3D and Synthia datasets. Copyright © 2020, The Authors. All rights reserved.

关键词： Embeddings