检索结果-内蒙古大学图书馆

TransForce: Transferable Force Prediction for Vision-based Tactile Sensors with Sequential Image Translation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Chen, Zhuo Ou, Ni Zhang, Xuyang Luo, Shan The Robot Perception Lab Centre for Robotics Research Department of Engineering King's College London LondonWC2R 2LS United Kingdom The State Key Laboratory of Intelligent Control and Decision of Complex Systems Beijing Institute of Technology Beijing100081 China

Vision-based tactile sensors (VBTSs) provide high-resolution tactile images crucial for robot in-hand manipulation. However, force sensing in VBTSs is underutilized due to the costly and time-intensive process of acquiring paired tactile images and force labels. In this study, we introduce a transferable force prediction model, TransForce, designed to leverage collected image-force paired data for new sensors under varying illumination colors and marker patterns while improving the accuracy of predicted forces, especially in the shear direction. Our model effectively achieves translation of tactile images from the source domain to the target domain, ensuring that the generated tactile images reflect the illumination colors and marker patterns of the new sensors while accurately aligning the elastomer deformation observed in existing sensors, which is beneficial to force prediction of new sensors. As such, a recurrent force prediction model trained with generated sequential tactile images and existing force labels is employed to estimate higher-accuracy forces for new sensors with lowest average errors of 0.69N (5.8% in full work range) in x-axis, 0.70N (5.8%) in y-axis, and 1.11N (6.9%) in z-axis compared with models trained with single images. The experimental results also reveal that pure marker modality is more helpful than the RGB modality in improving the accuracy of force in the shear direction, while the RGB modality show better performance in the normal direction. Copyright © 2024, The Authors. All rights reserved.

关键词： RGB color model

Coordinated Guiding Vector Field Design for Ordering-Flexible Multi-Robot Surface Navigation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Hu, Bin-Bin Zhang, Hai-Tao Yao, Weijia Sun, Zhiyong Cao, Ming The School of Artificial Intelligence and Automation The Engineering Research Center of Autonomous Intelligent Unmanned Systems The Key Laboratory of Image Processing and Intelligent Control The State Key Lab of Digital Manufacturing Equipment and Technology Huazhong University of Science and Technology Wuhan430074 China The School of Robotics Hunan University Hunan410082 China The Institute of Engineering and Technology University of Groningen Groningen9747 AG Netherlands Department of Electrical Engineering Eindhoven University of Technology Netherlands

We design a distributed coordinated guiding vector field (CGVF) for a group of robots to achieve ordering-flexible motion coordination while maneuvering on a desired two-dimensional (2D) surface. The CGVF is characterized by three terms, i.e., a convergence term to drive the robots to converge to the desired surface, a propagation term to provide a traversing direction for maneuvering on the desired surface, and a coordinated term to achieve the surface motion coordination with an arbitrary ordering of the robotic group. By setting the surface parameters as additional virtual coordinates, the proposed approach eliminates potential singularity of the CGVF and enables both the global convergence to the desired surface and the maneuvering on the surface from all possible initial conditions. The ordering-flexible surface motion coordination is realized by each robot to share with its neighbors only two virtual coordinates, i.e. that of a given target and that of its own, which reduces the communication and computation cost in multi-robot surface navigation. Finally, the effectiveness of the CGVF is substantiated by extensive numerical simulations. Copyright © 2024, The Authors. All rights reserved.

关键词： Navigation

Marker or Markerless? Mode-Switchable Optical Tactile Sensing for Diverse Robot Tasks

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Ou, Ni Chen, Zhuo Luo, Shan The State Key Laboratory of Intelligent Control and Decision of Complex Systems Beijing Institute of Technology Beijing100081 China The Robot Perception Lab. Centre for Robotics Research Department of Engineering King’s College London LondonWC2R 2LS United Kingdom

Optical tactile sensors play a pivotal role in robot perception and manipulation tasks. The membrane of these sensors can be painted with markers or remain markerless, enabling them to function in either marker or markerless mode. However, this uni-modal selection means the sensor is only suitable for either manipulation or perception tasks. While markers are vital for manipulation, they can also obstruct the camera, thereby impeding perception. The dilemma of selecting between marker and markerless modes presents a significant obstacle. To address this issue, we propose a novel mode-switchable optical tactile sensing approach that facilitates transitions between the two modes. The marker-to-markerless transition is achieved through a generative model, whereas its inverse transition is realized using a sparsely supervised regressive model. Our approach allows a single-mode optical sensor to operate effectively in both marker and markerless modes without the need for additional hardware, making it well-suited for both perception and manipulation tasks. Extensive experiments validate the effectiveness of our method. For perception tasks, our approach decreases the number of categories that include misclassified samples by 2 and improves contact area segmentation IoU by 3.53%. For manipulation tasks, our method attains a high success rate of 92.59% in slip detection. Code, dataset and demo videos are available at the project website https://***/Marker-Markerless-Transition/ Copyright © 2024, The Authors. All rights reserved.

关键词： Tactile sensors

6DoF-ICTC: A Deep Image Feature Extraction Network Combining Transformers and CNNs for 6DoF Pose Estimation 12

学校读者我要写书评

暂无评论

6DoF-ICTC: A Deep Image Feature Extraction Network Combining...

12th International Conference on CYBER Technology in Automation, Control, and intelligent systems, CYBER 2022

作者： Zhang, Liming Zhou, Xin Zhu, Baixian Wang, Can Wu, Xinyu Guangdong Provincial Key Lab of Robotics and Intelligent System Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences Shenzhen518055 China Cas Key Laboratory of Human-Machine Intelligence-Synergy Systems Shenzhen Institutes of Advanced Technology China University of Science and Technology of China China Department of Mechanical and Automation Engineering The Chinese University of Hong Kong Hong Kong

ISBN: (数字)9781665472678

ISBN: (纸本)9781665472678

In this work, we propose a new image feature extraction network for 6D pose estimation tasks. The majority of existing 6D pose estimation networks are based on the RGBD input, which is the fusion of images and point clouds. They are mainly working on keypoint extraction, point cloud feature extraction, and other tasks, however, image features, on the other hand, mainly rely on CNN networks that are currently advanced. With the development of Vision Transformer in the field of computer vision, the results on ImageNet demonstrate its benefit of extracting global features, and we see new directions that the Transformers can bring to the area of image feature extraction. ICTC is a Transformer paired with a CNN network that fuses the retrieved global features into each pixel and then does local feature extraction. This provides greater robustness to 6D pose estimation In complex situations such as shifting lighting conditions and object occlusion. Our method achieves 96% accuracy using the average ADD metric on the LineMOD dataset, demonstrating our method's effectiveness. © 2022 IEEE.

关键词： Feature extraction

Real-time Dexterous Telemanipulation with an End-Effect-Oriented Learning-based Approach

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Haoyang Bai, He Zhang, Xiaoli Jung, Yunsik Bowman, Michel Tao, Lingfeng The Oklahoma State University 563 Engineering North StillwaterOK74078 United States The Colorado School of Mines Intelligent Robotics and Systems Lab 1500 Illinois St GoldenCO80401 United States The University of Pennsylvania 3400 Civic Center Boulevard Building 421 PhiladelphiaPA19104 United States

Dexterous telemanipulation is crucial in advancing human-robot systems, especially in tasks requiring precise and safe manipulation. However, it faces significant challenges due to the physical differences between human and robotic hands, the dynamic interaction with objects, and the indirect control and perception of the remote environment. Current approaches predominantly focus on mapping the human hand onto robotic counterparts to replicate motions, which exhibits a critical oversight: it often neglects the physical interaction with objects and relegates the interaction burden to the human to adapt and make laborious adjustments in response to the indirect and counter-intuitive observation of the remote environment. This work develops an End-Effects-Oriented Learning-based Dexterous Telemanipulation (EFOLD) framework to address telemanipulation tasks. EFOLD models telemanipulation as a Markov Game, introducing multiple end-effect features to interpret the human operator's commands during interaction with objects. These features are used by a Deep Reinforcement Learning policy to control the robot and reproduce such end effects. EFOLD was evaluated with real human subjects and two end-effect extraction methods for controlling a virtual Shadow Robot Hand in telemanipulation tasks. EFOLD achieved real-time control capability with low command following latency (delay Copyright © 2024, The Authors. All rights reserved.

关键词： Robotic arms

User distributions in shard-based blockchain network: queueing modeling, game analysis, and protocol design 21

学校读者我要写书评

暂无评论

User distributions in shard-based blockchain network: queuei...

22nd International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing, MobiHoc 2021

作者： Chen, Canhui Ma, Qian Chen, Xu Huang, Jianwei School of Computer Science and Engineering Sun Yat-sen University Guangzhou China School of Intelligent Systems Engineering Sun Yat-sen University Shenzhen China Pazhou Lab Guangzhou China School of Science and Engineering Shenzhen Institute of Artificial Intelligence and Robotics for Society Chinese University of Hong Kong Shenzhen Hong Kong

ISBN: (纸本)9781450385589

Sharding is one of the most promising and practical methods to achieve horizontal scalability of blockchain networks. However, the increasing number of cross-shard transactions in blockchain sharding protocols may degrade the system throughput. In this paper, we investigate how to distribute users properly in the shard-based blockchains to boost the system transaction performance. We first build an open Jackson queueing network model to capture users' transaction dynamics on shards. Then we cast users' interactions as a shard-based blockchain game, wherein each user aims to minimize its transaction confirmation time and transaction fee. We investigate the equilibrium of the game, and design a polynomial-time algorithm to find efficient equilibria with good system performance. We further design a novel sharding protocol with dynamic user distribution for the permissionless blockchain, and the protocol can maintain good performance in long-term dynamic environment. Extensive numerical results using realistic blockchain transaction data demonstrate that the proposed algorithm and the designed protocol can achieve superior performance for shard-based blockchains. © 2021 ACM.

关键词： Game theory

Efficient Robust Principal Component Analysis via Block Krylov Iteration and CUR Decomposition

学校读者我要写书评

暂无评论

Efficient Robust Principal Component Analysis via Block Kryl...

Conference on Computer Vision and Pattern Recognition (CVPR)

作者： Shun Fang Zhengqin Xu Shiqian Wu Shoulie Xie School of Information Science and Engineering Wuhan University of Science and Technology China Institute of Robotics and Intelligent Systems Wuhan University of Science and Technology China MoE Key Lab of Artificial Intelligence AI Institute Shanghai Jiao Tong University China Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial Systems Signal Processing RF & Optical Dept. Institute for Infocomm Research A*STAR Singapore

Robust principal component analysis (RPCA) is widely studied in computer vision. Recently an adaptive rank estimate based RPCA has achieved top performance in low-level vision tasks without the prior rank, but both the rank estimate and RPCA optimization algorithm involve singular value decomposition, which requires extremely huge computational resource for large-scale matrices. To address these issues, an efficient RPCA (eRPCA) algorithm is proposed based on block Krylov iteration and CUR decomposition in this paper. Specifically, the Krylov iteration method is employed to approximate the eigenvalue decomposition in the rank estimation, which requires $O(ndrq+n(rq)^{2})$ for an $(n\times d)$ input matrix, in which $q$ is a parameter with a small value, $r$ is the target rank. Based on the estimated rank, CUR decomposition is adopted to replace SVD in updating low-rank matrix component, whose complexity reduces from $O(rnd)$ to $O(r^{2}n)$ per iteration. Experimental results verify the efficiency and effectiveness of the proposed eRPCA over the state-of-the-art methods in various low-level vision applications.

关键词：

Design and simulation of a hip exoskeleton for lateral walking

学校读者我要写书评

暂无评论

Design and simulation of a hip exoskeleton for lateral walki...

2021 IEEE International Conference on Real-Time Computing and robotics, RCAR 2021

作者： Zhang, Zhewen Cao, Wujing Chen, Chunjie Yu, Hongliu Wu, Xinyu Meng, Qiaoling Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Guangdong Provincial Key Lab of Robotics and Intelligent System University of Shanghai for Science and Technology Rehabilitation Engineering and Technology Institute CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems Shenzhen Institute of Advanced Technology

ISBN: (纸本)9781665436786

In this article, a rehabilitation exoskeleton assisted by lateral walking is designed to help patients with lower limb movement disorders to solve the problem of lateral walking assistance, so as to achieve the effect of rehabilitation training. Based on the characteristics of lateral movement of human body, the exoskeleton designed in this paper uses linear push rod motor and thigh binding to assist hip abduction and adduction respectively. Based on the research of human transverse movement gait, a reasonable linkage mechanism was designed and kinematics simulation was carried out. The dynamics model of human lower limbs was established and calculated with MATlab simulation software. the moment of hip joint lateral movement is obtained. Finally, the structural parameters of the driving mechanism were analyzed by dynamic simulation, and the simulation results were compared with the target motion function to verify the rationality of the design. © 2021 IEEE.

关键词： MATlab

An Evaluation of Direct Image Based Visual Tracking System for Autonomous Manipulation* 48

学校读者我要写书评

暂无评论

An Evaluation of Direct Image Based Visual Tracking System f...

48th Annual Conference of the IEEE Industrial Electronics Society, IECON 2022

作者： Islam, S. Saleh, A. Dias, J. Sunda-Meya, A. Xavier University of Louisiana Dual Degree Engineering Program Intelligent Robotics Mechatronics & Autonomous Systems Lab 1 Drexel Drive New OrleansLA70125 United States Khalifa University United Arab Emirates Coimbra3030-260 Portugal Khalifa University Khalifa University Autonomous Vehicles Lab United Arab Emirates Xavier University of Louisiana College of Arts & Sciences 1 Drexel Drive New OrleansLA70125 United States

ISBN: (数字)9781665480253

ISBN: (纸本)9781665480253

In this paper, we implement and evaluate a direct image-based visual tracking system for autonomous manipulation applications. The direct image-based visual tracking method is developed to relax complex image processing tasks from traditional image and position-based visual tracking methods. The visual signals are constructed by using multiresolution coefficients. The method compares the multiresolution image transformation of the current and desired images and uses the mismatch between them to drive the system. The method needs to design a multiresolution interaction matrix with half and details images. The matrix connects the multiresolution image transformation coefficients with the velocity of the manipulator and controller. To illustrate the effectiveness, the direct image-based tracking system design is implemented and evaluated to locate the position of the valve stem and set of wrenches for autonomous grasping and manipulation for fire fighting applications. © 2022 IEEE.

关键词： Linear transformations