检索结果-内蒙古大学图书馆

arXiv 2023年

作者： He, Yong Yu, Hongshan Yang, Zhengeng Liu, Xiaoyan Sun, Wei Mian, Ajmal National Engineering Laboratory for Robot Visual Perception and Control Technology College of Electrical and Information Engineering Hunan University Lushan South Rd. Yuelu Dist. Changsha410082 China Department of Computer Science The University of Western Australia WA6009 Australia

Point cloud processing methods exploit local point features and global context through aggregation which does not explicity model the internal correlations between local and global features. To address this problem, we propose full point encoding which is applicable to convolution and transformer architectures. Specifically, we propose Full Point Convolution (FPConv) and Full Point Transformer (FPTransformer) architectures. The key idea is to adaptively learn the weights from local and global geometric connections, where the connections are established through local and global correlation functions respectively. FPConv and FPTransformer simultaneously model the local and global geometric relationships as well as their internal correlations, demonstrating strong generalization ability and high performance. FPConv is incorporated in classical hierarchical network architectures to achieve local and global shape-aware learning. In FPTransformer, we introduce full point position encoding in self-attention, that hierarchically encodes each point position in the global and local receptive field. We also propose a shape aware downsampling block which takes into account the local shape and the global context. Experimental comparison to existing methods on benchmark datasets show the efficacy of FPConv and FPTransformer for semantic segmentation, object detection, classification, and normal estimation tasks. In particular, we achieve state-of-the-art semantic segmentation results of 76% mIoU on S3DIS 6-fold and 72.2% on S3DIS Area 5. Copyright © 2023, The Authors. All rights reserved.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

E-3DGS: Gaussian Splatting with Exposure and Motion Events

arXiv

引用

arXiv 2024年

作者： Yin, Xiaoting Shi, Hao Bao, Yuhan Bing, Zhenshan Liao, Yiyi Yang, Kailun Wang, Kaiwei State Key Laboratory of Modern Optical Instrumentation Zhejiang University China School of Robotics National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China College of Information Science and Electronic Engineering Zhejiang University China The Chair of Robotics AI and Real-Time Systems Technical University of Munich Germany

Estimating Neural Radiance Fields (NeRFs) from images captured under optimal conditions has been extensively explored in the vision community. However, robotic applications often face challenges such as motion blur, insufficient illumination, and high computational overhead, which adversely affect downstream tasks like navigation, inspection, and scene visualization. To address these challenges, we propose E-3DGS, a novel event-based approach that partitions events into motion (from camera or object movement) and exposure (from camera exposure), using the former to handle fast-motion scenes and using the latter to reconstruct grayscale images for high-quality training and optimization of event-based 3D Gaussian Splatting (3DGS). We introduce a novel integration of 3DGS with exposure events for high-quality reconstruction of explicit scene representations. Our versatile framework can operate on motion events alone for 3D reconstruction, enhance quality using exposure events, or adopt a hybrid mode that balances quality and effectiveness by optimizing with initial exposure events followed by high-speed motion events. We also introduce EME-3D, a real-world 3D dataset with exposure events, motion events, camera calibration parameters, and sparse point clouds. Our method is faster and delivers better reconstruction quality than event-based NeRF while being more cost-effective than NeRF methods that combine event and RGB data by using a single event sensor. By combining motion and exposure events, E-3DGS sets a new benchmark for event-based 3D reconstruction with robust performance in challenging conditions and lower hardware demands. The source code and dataset will be available at https://***/MasterHow/E-3DGS. Copyright © 2024, The Authors. All rights reserved.

关键词： Gaussian distribution

来源：评论

学校读者我要写书评

暂无评论

Deep Domain Adaptation Regression for Force Calibration of Optical Tactile Sensors

arXiv

引用

arXiv 2024年

作者： Chen, Zhuo Ou, Ni Jiang, Jiaqi Luo, Shan Robot Perception Lab Centre for Robotics Research Department of Engineering King’s College London LondonWC2R 2LS United Kingdom State Key Laboratory of Intelligent Control and Decision of Complex Systems Beijing Institute of Technology Beijing100081 China

Optical tactile sensors provide robots with rich force information for robot grasping in unstructured environments. The fast and accurate calibration of three-dimensional contact forces holds significance for new sensors and existing tactile sensors which may have incurred damage or aging. However, the conventional neural-network-based force calibration method necessitates a large volume of force-labeled tactile images to minimize force prediction errors, with the need for accurate Force/Torque measurement tools as well as a time-consuming data collection process. To address this challenge, we propose a novel deep domain-adaptation force calibration method, designed to transfer the force prediction ability from a calibrated optical tactile sensor to uncalibrated ones with various combinations of domain gaps, including marker presence, illumination condition, and elastomer modulus. Experimental results show the effectiveness of the proposed unsupervised force calibration method, with lowest force prediction errors of 0.102N (3.4% in full force range) for normal force, and 0.095N (6.3%) and 0.062N (4.1%) for shear forces along the x-axis and y-axis, respectively. This study presents a promising, general force calibration methodology for optical tactile sensors. Copyright © 2024, The Authors. All rights reserved.

关键词： Forecasting

来源：评论

学校读者我要写书评

暂无评论

TransForce: Transferable Force Prediction for Vision-based Tactile Sensors with Sequential Image Translation

arXiv

引用

arXiv 2024年

作者： Chen, Zhuo Ou, Ni Zhang, Xuyang Luo, Shan The Robot Perception Lab Centre for Robotics Research Department of Engineering King's College London LondonWC2R 2LS United Kingdom The State Key Laboratory of Intelligent Control and Decision of Complex Systems Beijing Institute of Technology Beijing100081 China

Vision-based tactile sensors (VBTSs) provide high-resolution tactile images crucial for robot in-hand manipulation. However, force sensing in VBTSs is underutilized due to the costly and time-intensive process of acquiring paired tactile images and force labels. In this study, we introduce a transferable force prediction model, TransForce, designed to leverage collected image-force paired data for new sensors under varying illumination colors and marker patterns while improving the accuracy of predicted forces, especially in the shear direction. Our model effectively achieves translation of tactile images from the source domain to the target domain, ensuring that the generated tactile images reflect the illumination colors and marker patterns of the new sensors while accurately aligning the elastomer deformation observed in existing sensors, which is beneficial to force prediction of new sensors. As such, a recurrent force prediction model trained with generated sequential tactile images and existing force labels is employed to estimate higher-accuracy forces for new sensors with lowest average errors of 0.69N (5.8% in full work range) in x-axis, 0.70N (5.8%) in y-axis, and 1.11N (6.9%) in z-axis compared with models trained with single images. The experimental results also reveal that pure marker modality is more helpful than the RGB modality in improving the accuracy of force in the shear direction, while the RGB modality show better performance in the normal direction. Copyright © 2024, The Authors. All rights reserved.

关键词： RGB color model

来源：评论

学校读者我要写书评

暂无评论

Marker or Markerless? Mode-Switchable Optical Tactile Sensing for Diverse robot Tasks

arXiv

引用

arXiv 2024年

作者： Ou, Ni Chen, Zhuo Luo, Shan The State Key Laboratory of Intelligent Control and Decision of Complex Systems Beijing Institute of Technology Beijing100081 China The Robot Perception Lab. Centre for Robotics Research Department of Engineering King’s College London LondonWC2R 2LS United Kingdom

Optical tactile sensors play a pivotal role in robot perception and manipulation tasks. The membrane of these sensors can be painted with markers or remain markerless, enabling them to function in either marker or markerless mode. However, this uni-modal selection means the sensor is only suitable for either manipulation or perception tasks. While markers are vital for manipulation, they can also obstruct the camera, thereby impeding perception. The dilemma of selecting between marker and markerless modes presents a significant obstacle. To address this issue, we propose a novel mode-switchable optical tactile sensing approach that facilitates transitions between the two modes. The marker-to-markerless transition is achieved through a generative model, whereas its inverse transition is realized using a sparsely supervised regressive model. Our approach allows a single-mode optical sensor to operate effectively in both marker and markerless modes without the need for additional hardware, making it well-suited for both perception and manipulation tasks. Extensive experiments validate the effectiveness of our method. For perception tasks, our approach decreases the number of categories that include misclassified samples by 2 and improves contact area segmentation IoU by 3.53%. For manipulation tasks, our method attains a high success rate of 92.59% in slip detection. Code, dataset and demo videos are available at the project website https://***/Marker-Markerless-Transition/ Copyright © 2024, The Authors. All rights reserved.

关键词： Tactile sensors

来源：评论

学校读者我要写书评

暂无评论

HierDAMap: Towards Universal Domain Adaptive BEV Mapping via Hierarchical Perspective Priors

arXiv

引用

arXiv 2025年

作者： Li, Siyu Cao, Yihong Shi, Hao Zang, Yongsheng He, Xuan Yang, Kailun Li, Zhiyong School of Robotics the National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China College of Computer Science and Electronic Engineering Hunan University Changsha410082 China Hunan Vanguard Group Corporation Limited Changsha410100 China

The exploration of Bird’s-Eye View (BEV) mapping technology has driven significant innovation in visual perception technology for autonomous driving. BEV mapping models need to be applied to the unlabeled real world, making the study of unsupervised domain adaptation models an essential path. However, research on unsupervised domain adaptation for BEV mapping remains limited and cannot perfectly accommodate all BEV mapping tasks. To address this gap, this paper proposes HierDAMap, a universal and holistic BEV domain adaptation framework with hierarchical perspective priors. Unlike existing research that solely focuses on image-level learning using prior knowledge, this paper explores the guiding role of perspective prior knowledge across three distinct levels: global, sparse, and instance levels. With these priors, HierDA consists of three essential components, including Semantic-Guided Pseudo Supervision (SGPS), Dynamic-Aware Coherence Learning (DACL), and Cross-Domain Frustum Mixing (CDFM). SGPS constrains the cross-domain consistency of perspective feature distribution through pseudo labels generated by vision foundation models in 2D space. To mitigate feature distribution discrepancies caused by spatial variations, DACL employs uncertainty-aware predicted depth as an intermediary to derive dynamic BEV labels from perspective pseudo-labels, thereby constraining the coarse BEV features derived from corresponding perspective features. CDFM, on the other hand, leverages perspective masks of view frustum to mix multi-view perspective images from both domains, which guides cross-domain view transformation and encoding learning through mixed BEV labels. Furthermore, this paper introduces intra-domain feature exchange data augmentation to enhance the efficiency of domain adaptation learning. The proposed method is verified on multiple BEV mapping tasks, such as BEV semantic segmentation, high-definition semantic, and vectorized mapping. It demonstrates competitive perfo

关键词： Birds

来源：评论

学校读者我要写书评

暂无评论

PanoVPR: Towards Unified Perspective-to-Equirectangular Visual Place Recognition via Sliding Windows across the Panoramic View

arXiv

引用

arXiv 2023年

作者： Shi, Ze Shi, Hao Yang, Kailun Yin, Zhe Lin, Yining Wang, Kaiwei State Key Laboratory of Modern Optical Instrumentation Zhejiang University Hangzhou China School of Robotics and with the National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China Shanghai SUPREMIND Technology Co Ltd Shanghai China

— Visual place recognition has gained significant attention in recent years as a crucial technology in autonomous driving and robotics. Currently, the two main approaches are the perspective view retrieval (P2P) paradigm and the equirectangular image retrieval (E2E) paradigm. However, it is practical and natural to assume that users only have consumer-grade pinhole cameras to obtain query perspective images and retrieve them in panoramic database images from map providers. To address this, we propose PanoVPR, a perspective-to-equirectangular (P2E) visual place recognition framework that employs sliding windows to eliminate feature truncation caused by hard cropping. Specifically, PanoVPR slides windows over the entire equirectangular image and computes feature descriptors for each window, which are then compared to determine place similarity. Notably, our unified framework enables direct transfer of the backbone from P2P methods without any modification, supporting not only CNNs but also Transformers. To facilitate training and evaluation, we derive the Pitts250k-P2E dataset from the Pitts250k and establish YQ360, latter is the first P2E visual place recognition dataset collected by a mobile robot platform aiming to simulate real-world task scenarios better. Extensive experiments demonstrate that PanoVPR achieves state-of-the-art performance and obtains 3.8% and 8.0% performance gain on Pitts250k-P2E and YQ360 compared to the previous best method, respectively. Code and datasets will be publicly available at PanoVPR. Copyright © 2023, The Authors. All rights reserved.

关键词： Query processing

来源：评论

学校读者我要写书评

暂无评论

Single-Leader-Dual-Follower Teleoperation in Object-Holding Task with Internal Force Regulation 26

Single-Leader-Dual-Follower Teleoperation in Object-Holding ...

引用

26th International Conference on Automation and Computing, ICAC 2021

作者： Huang, Darong Jiang, Yiming Yang, Chenguang South China University of Technology School of Automation Science and Engineering Guangzhou510641 China Hunan University National Engineering Laboratory for Robot Visual Perception and Control Changsha410082 China University of the West of England Bristol Robotics Laboratory BristolBS16 1QY United Kingdom

ISBN: (纸本)9781860435577

robot teleoperation attracts growing attention of researchers in many domains. Plenty of factors contribute to the good performance of a smart teleoperation system, and one crucial factor is that it provides an environmental feedback for the operator. Hence, in this paper, we offer a solution to help operator to perceive the contact force of the tele-robot. In addition, we introduce a strategy to cooperatively teleoperate two follower robots by using only single leader1 robot, which helps to reduce the control burden for the operator, as well as enables the teleoperation system to avoid the problem caused by the mismatched degree of freedom (DoF). Moreover, an impedance model based technique is employed to regulate the holding internal force during object-holding tasks. Experiments are conducted gradually, using a Touch X device as the leader robot and two arms of the Baxter robot as the tele-robots. Experimental results validate the feasibility of the proposed teleoperation system. © 2021 Chinese Automation and Computing Society in the UK-CACSUK.

关键词： Remote control

来源：评论

学校读者我要写书评

暂无评论

AdaptiveClick: Clicks-aware Transformer with Adaptive Focal Loss for Interactive Image Segmentation

arXiv

引用

arXiv 2023年

作者： Lin, Jiacheng Chen, Jiajun Yang, Kailun Roitberg, Alina Li, Siyu Li, Zhiyong Li, Shutao The College of Computer Science and Electronic Engineering Hunan University Changsha410082 China The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China The Institute for Artificial Intelligence The University of Stuttgart Stuttgart70569 Germany The College of Electrical and Information Engineering The Key Laboratory of Visual Perception and Artificial Intelligence of Hunan Province Hunan University Changsha410082 China

Interactive Image Segmentation (IIS) has emerged as a promising technique for decreasing annotation time. Substantial progress has been made in pre- and post-processing for IIS, but the critical issue of interaction ambiguity, notably hindering segmentation quality, has been under-researched. To address this, we introduce ADAPTIVECLICK – a click-aware transformer incorporating an adaptive focal loss that tackles annotation inconsistencies with tools for mask- and pixel-level ambiguity resolution. To the best of our knowledge, AdaptiveClick is the first transformer-based, mask-adaptive segmentation framework for IIS. The key ingredient of our method is the Click-Aware Mask-adaptive transformer Decoder (CAMD), which enhances the interaction between click and image features. Additionally, AdaptiveClick enables pixel-adaptive differentiation of hard and easy samples in the decision space, independent of their varying distributions. This is primarily achieved by optimizing a generalized Adaptive Focal Loss (AFL) with a theoretical guarantee, where two adaptive coefficients control the ratio of gradient values for hard and easy pixels. Our analysis reveals that the commonly used Focal and BCE losses can be considered special cases of the proposed AFL. With a plain ViT backbone, extensive experimental results on nine datasets demonstrate the superiority of AdaptiveClick compared to state-of-the-art methods. The source code is publicly available at https://***/lab206/AdaptiveClick. Copyright © 2023, The Authors. All rights reserved.

关键词： Pixels

来源：评论

学校读者我要写书评

暂无评论

Dynamic Hand Gesture Recognition via Electromyographic Signal Based on Convolutional Neural Network

Dynamic Hand Gesture Recognition via Electromyographic Signa...

引用

IEEE International Conference on Systems, Man and Cybernetics

作者： Shouan Song Lei Yang Man Wu Yanhong Liu Hongnian Yu School of Electrical Engineering Zhengzhou University China Robot Perception and Control Engineering Laboratory of Henan Province China Beijing Aerospace Control Center Beijing China Built Environment Edinburgh Napier University Edinburgh UK

ISBN: (纸本)9781665442084

Dynamic gesture recognition is a typical human-computer interaction method owing to its great potential in practical applications. Currently, most of research work on gesture recognition has mainly focused on vision-based and surface electromyography (sEMG) methods. Compared to vision-based methods, the sequential sEMG signal can directly depict the muscle activity of different gestures which could lead to higher recognition efficiency. However, the effective feature design and selection of sEMG signal is still complicated since muscle fatigue and small electrode displacement will affect the recognition precision of sEMG signals. In this paper, a novel end-to-end dynamic gesture recognition method is developed. The raw sEMG signals are converted into an image form by using the time-frequency transformation method to obtain more comprehensive information for model training and test. And a recognition model based on Convolutional Neural Network (CNN) model is built for high-precision time-frequency image recognition. Experiments indicate that the proposed method could acquire distinguishing features from the pre-prossed images and the overall recognition accuracy on different gestures can reach up to 98.3%.

关键词： Training Time-frequency analysis Image recognition Continuous wavelet transforms Neural networks Gesture recognition Muscles

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：