检索结果-内蒙古大学图书馆

Deep Learning-Enabled ISAC-OTFS Pre-equalization Design for Aerial-Terrestrial Networks

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wang, Weihao Guo, Jing Wang, Siqiang Wang, Xinyi Yuan, Weijie Fei, Zesong the School of Information and Electronics Beijing Institute of Technology Beijing100081 China the School of System Design and Intelligent Manufacturing The Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen518055 China

Orthogonal time frequency space (OTFS) modulation has been viewed as a promising technique for integrated sensing and communication (ISAC) systems and aerial-terrestrial networks, due to its delay-Doppler domain transmission property and strong Doppler-resistance capability. However, it also suffers from high processing complexity at the receiver. In this work, we propose a novel pre-equalization based ISAC-OTFS transmission framework, where the terrestrial base station (BS) executes pre-equalization based on its estimated channel state information (CSI). In particular, the mean square error of OTFS symbol demodulation and Cramér-Rao lower bound of sensing parameter estimation are derived, and their weighted sum is utilized as the metric for optimizing the pre-equalization matrix. To address the formulated problem while taking the time-varying CSI into consideration, a deep learning enabled channel prediction-based pre-equalization framework is proposed, where a parameter-level channel prediction module is utilized to decouple OTFS channel parameters, and a low-dimensional prediction network is leveraged to correct outdated CSI. A CSI processing module is then used to initialize the input of the pre-equalization module. Finally, a residual-structured deep neural network is cascaded to execute pre-equalization. Simulation results show that under the proposed framework, the demodulation complexity at the receiver as well as the pilot overhead for channel estimation, are significantly reduced, while the symbol detection performance approaches those of conventional minimum mean square error equalization and perfect CSI. Copyright © 2024, The Authors. All rights reserved.

关键词： Channel estimation

GraspGPT: Leveraging Semantic Knowledge from a Large Language Model for Task-Oriented Grasping

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Tang, Chao Huang, Dehao Ge, Wenqi Liu, Weiyu Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China Institute for Robotics and Intelligent Machines Georgia Institute of Technology Atlanta United States

Task-oriented grasping (TOG) refers to the problem of predicting grasps on an object that enable subsequent manipulation tasks. To model the complex relationships between objects, tasks, and grasps, existing methods incorporate semantic knowledge as priors into TOG pipelines. However, the existing semantic knowledge is typically constructed based on closed-world concept sets, restraining the generalization to novel concepts out of the pre-defined sets. To address this issue, we propose GraspGPT, a large language model (LLM) based TOG framework that leverages the open-end semantic knowledge from an LLM to achieve zero-shot generalization to novel concepts. We conduct experiments on Language Augmented TaskGrasp (LA-TaskGrasp) dataset and demonstrate that GraspGPT outperforms existing TOG methods on different held-out settings when generalizing to novel concepts out of the training set. The effectiveness of GraspGPT is further validated in real-robot experiments. Our code, data, appendix, and video are publicly available at https://***/view/graspgpt. Copyright © 2023, The Authors. All rights reserved.

关键词： Zero-shot learning

Social Space Segmentation for Approaching Tasks

学校读者我要写书评

暂无评论

Social Space Segmentation for Approaching Tasks

IEEE International Workshop on Robot and Human Communication (ROMAN)

作者： Aline F. F. Silva Douglas G. Macharet Department of Computer Science Computer Vision and Robotics Laboratory (VeRLab) Universidade Federal de Minas Gerais Brazil Laboratório de Inteligência Computacional e Robótica (LICRo) Instituto Federal do Triângulo Mineiro (IFTM) Brazil

ISBN: (数字)9798350375022

ISBN: (纸本)9798350375039

This paper introduces a novel methodology for the partitioning of the social space associated with arbitrary groups of individuals into approachable regions. The proposed method exploits boundary points within pre-identified social spaces and classifies them into three distinct levels based on the field of view between pairs of individuals within the group. The effectiveness of this approach was rigorously assessed across both static and dynamic scenarios, illustrating successful segmentation and classification of approachable regions. Furthermore, the methodology underwent comprehensive testing using publicly available datasets, yielding consistently satisfactory outcomes. This innovative approach represents a substantial contribution to the field of human-robot interaction, showcasing significant potential for future enhancements and advancements.

关键词： Human-robot interaction Robots Testing

An Experimental Study of Keypoint Descriptor Fusion

学校读者我要写书评

暂无评论

An Experimental Study of Keypoint Descriptor Fusion

IEEE International Conference on robotics and Biomimetics

作者： Yaling Pan Li He Yisheng Guan Hong Zhang Biomimetic Intelligent Robotics Research Laboratory (BIRL) Guangdong University of Technology Guangzhou China Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China

ISBN: (纸本)9781665481106

Local feature descriptors play a crucial role in computer vision problems, especially robot motion. Existing descriptors are highly accurate, but their performance de-pends on the influence of distracting factors, such as illumi-nation and viewpoint. There is room for further improvement of these descriptors. In this paper, we provide an in-depth analysis of several exciting features of the descriptor fusion model (DFM) we have proposed in our recent work, which uses an autoencoder to combine descriptors and exploit their respective advantages. With this DFM framework, we fur-ther validate that fused descriptors can retain advantageous properties and that our DFM is a generally applicable method with respect to various component descriptors. Specifically, we evaluate multiple combinations of hand-crafted and CNN descriptors concerning their performance on a benchmark dataset with illumination and viewpoint changes to obtain comprehensive experimental results. The results show that the fused descriptors have better matching accuracy than their component descriptors.

关键词： Robot motion computer vision Analytical models Biomimetics Lighting Benchmark testing

HairDiffusion: Vivid Multi-Colored Hair Editing via Latent Diffusion

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Zeng, Yu Zhang, Yang Liu, Jiachen Shen, Linlin Deng, Kaijun He, Weizhao Wang, Jinbao Computer Vision Institute School of Computer Science & Software Engineering Shenzhen University China Shenzhen Institute of Artificial Intelligence and Robotics for Society China National Engineering Laboratory for Big Data System Computing Technology Shenzhen University China Guangdong Provincial Key Laboratory of Intelligent Information Processing China

Hair editing is a critical image synthesis task that aims to edit hair color and hairstyle using text descriptions or reference images, while preserving irrelevant attributes (e.g., identity, background, cloth). Many existing methods are based on StyleGAN to address this task. However, due to the limited spatial distribution of StyleGAN, it struggles with multiple hair color editing and facial preservation. Considering the advancements in diffusion models, we utilize Latent Diffusion Models (LDMs) for hairstyle editing. Our approach introduces Multi-stage Hairstyle Blend (MHB), effectively separating control of hair color and hairstyle in diffusion latent space. Additionally, we train a warping module to align the hair color with the target region. To further enhance multi-color hairstyle editing, we fine-tuned a CLIP model using a multi-color hairstyle dataset. Our method not only tackles the complexity of multi-color hairstyles but also addresses the challenge of preserving original colors during diffusion editing. Extensive experiments showcase the superiority of our method in editing multi-color hairstyles while preserving facial attributes given textual descriptions and reference images. © 2024, CC BY.

关键词： Color image processing

Task-Oriented Grasp Prediction with Visual-Language Inputs

学校读者我要写书评

暂无评论

Task-Oriented Grasp Prediction with Visual-Language Inputs

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Chao Tang Dehao Huang Lingxiao Meng Weiyu Liu Hong Zhang Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China Stanford University United States

To perform household tasks, assistive robots receive commands in the form of user language instructions for tool manipulation. The initial stage involves selecting the intended tool (i.e., object grounding) and grasping it in a task-oriented manner (i.e., task grounding). Nevertheless, prior researches on visual-language grasping (VLG) focus on object grounding, while disregarding the fine-grained impact of tasks on object grasping. Task-incompatible grasping of a tool will inevitably limit the success of subsequent manipulation steps. Motivated by this problem, this paper proposes GraspCLIP, which addresses the challenge of task grounding in addition to object grounding to enable task-oriented grasp prediction with visual-language inputs. Evaluation on a custom dataset demonstrates that GraspCLIP achieves superior performance over established baselines with object grounding only. The effectiveness of the proposed method is further validated on an assistive robotic arm for grasping previously unseen kitchen tools given the task specification. Our presentation video is available at: https://***/watch?v=e1wfYQPeAXU.

关键词：

Combining Scene Coordinate Regression and Absolute Pose Regression for Visual Relocalization

学校读者我要写书评

暂无评论

Combining Scene Coordinate Regression and Absolute Pose Regr...

IEEE International Conference on robotics and Automation (ICRA)

作者： Jiahao Ruan Li He Yisheng Guan Hong Zhang School of Electromechanical Engineering Guangdong University of Technology Guangzhou China Department of Electrical and Electronic Engineering Shenzhen Key - Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China

Visual relocalization is a fundamental problem in computer vision and robotics. Recently, regression-based methods become popular and they can be categorized into two classes: absolute pose regression and scene coordinate regression. In this work, we present a combined regression network that jointly learns scene coordinate regression and absolute pose regression for single-image visual relocalization. The proposed network composes of a feature encoder and two regression branches with uncertainty modeling. In particular, we design a deep feature conditioning module, aiming at propagating the coarse pose information in absolute pose regression to inform the predictions in scene coordinate regression. The proposed network is trained in an end-to-end fashion to learn both regression tasks. Moreover, we propose an uncertainty-driven RANSAC algorithm that incorporates the predicted scene coordinates and their uncertainties to solve the camera pose during inference. To the best of our knowledge, this work is the first to combine scene coordinate regression and pose regression in a hierarchical framework for visual relocalization. Experiments on indoor and outdoor benchmarks demonstrate the effectiveness and the superiority of the proposed method over the state-of-the-art methods.

关键词：

Graph Neural Networks for Human-Aware Social Navigation 21st

学校读者我要写书评

暂无评论

Graph Neural Networks for Human-Aware Social Navigation

21st International Workshop of Physical Agents, WAF 2020

作者： Manso, Luis J. Jorvekar, Ronit R. Faria, Diego R. Bustos, Pablo Bachiller, Pilar Department of Computer Science College of Engineering and Physical Sciences Aston University Birmingham United Kingdom Department of Computer Engineering Pune Institute of Computer Technology Pune India Robotics and Artificial Vision Laboratory University of Extremadura Badajoz Spain

ISBN: (纸本)9783030625788

Autonomous navigation is a key skill for assistive and service robots. To be successful, robots have to comply with social rules, such as avoiding the personal spaces of the people surrounding them, or not getting in the way of human-to-human and human-to-object interactions. This paper suggests using Graph Neural Networks to model how inconvenient the presence of a robot would be in a particular scenario according to learned human conventions so that it can be used by path planning algorithms. To do so, we propose two automated scenario-to-graph transformations and benchmark them with different Graph Neural Networks using the SocNav1 dataset [1]. We achieve close-to-human performance in the dataset and argue that, in addition to its promising results, the main advantage of the approach is its scalability in terms of the number of social factors that can be considered and easily embedded in code in comparison with model-based approaches. The code used to train and test the resulting graph neural network is available in a public repository. © 2021, The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG.

关键词： Human robot interaction

Boosting Adversarial Transferability across Model Genus by Deformation-Constrained Warping

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Lin, Qinliang Luo, Cheng Niu, Zenghao He, Xilin Xie, Weicheng Hou, Yuanbo Shen, Linlin Song, Siyang Computer Vision Institute School of Computer Science & Software Engineering Shenzhen University China Shenzhen Institute of Artificial Intelligence and Robotics for Society China Guangdong Key Laboratory of Intelligent Information Processing China WAVES Research Group Ghent University Belgium University of Leicester United Kingdom

Adversarial examples generated by a surrogate model typically exhibit limited transferability to unknown target systems. To address this problem, many transferability enhancement approaches (e.g., input transformation and model augmentation) have been proposed. However, they show poor performances in attacking systems having different model genera from the surrogate model. In this paper, we propose a novel and generic attacking strategy, called Deformation-Constrained Warping Attack (DeCoWA), that can be effectively applied to cross model genus attack. Specifically, DeCoWA firstly augments input examples via an elastic deformation, namely Deformation-Constrained Warping (DeCoW), to obtain rich local details of the augmented input. To avoid severe distortion of global semantics led by random deformation, DeCoW further constrains the strength and direction of the warping transformation by a novel adaptive control strategy. Extensive experiments demonstrate that the transferable examples crafted by our DeCoWA on CNN surrogates can significantly hinder the performance of Transformers (and vice versa) on various tasks, including image classification, video action recognition, and audio recognition. Code is made available at https://***/LinQinLiang/DeCoWA. © 2024, CC BY-NC-SA.

关键词： Semantics