检索结果-内蒙古大学图书馆

IEEE/RSJ International Conference on Intelligent robots and Systems (IROS)

作者： Lin Chen Yaonan Wang Zhiqiang Miao Mingtao Feng Yuanzhe Wang Yang Mo Zhen Zhou Hesheng Wang Danwei Wang School of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Visual Perception and Control Technology Changsha China School of Artificial Intelligence Xidian University Xian China School of Electrical and Electrical Engineering Nanyang Technological University Nanyang Avenue Singapore Department of Automation Shanghai Jiao Tong University Shanghai China

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Navigating robots through dynamic multi-robot environments, avoiding collisions with both other robots and obstacles, has emerged as a central challenge in robotics. The existing approaches fall short in allowing the policy network to effectively capture spatial-temporal reciprocal collision avoidance in multi-robot environments, comprising both static and dynamic obstacles, resulting in inadequate safety and efficiency in directing robot movement. In this study, we introduce a novel policy neural network called Spatial-Temporal RetNet (STR), designed to encode reciprocal collision avoidance states between robots in spatial and temporal dimensions. The goal is to improve the safety and efficacy of the policy neural network in directing robots to complete assigned tasks. The spatial state encoder module is built upon a parallel RetNet structure, which strengthens the neural network's capacity in extracting reciprocal collision avoidance states between robots in spatial dimensions. This module addresses the limitations of position encoding in transformer-based multi-robot navigation policy neural networks. We design a temporal state encoder utilizing a recurrent RetNet structure. This innovation bolsters the multi-robot navigation policy neural network's capability to capture features in the temporal dimension of multi-robot movements. It addresses the limitations of transformer-based multi-robot navigation policy neural networks, particularly in recurrently inferring information across time dimensions. Simulation experiments were conducted to showcase the superior safety and effectiveness of our proposed method compared to previous state-of-the-art approaches in guiding robots to accomplish tasks.

关键词： Training Technological innovation Navigation Neural networks Transformers Feature extraction Encoding Safety Collision avoidance robots

来源：评论

学校读者我要写书评

暂无评论

DANet: Density Adaptive Convolutional Network with Interactive Attention for 3D Point Clouds

arXiv

引用

arXiv 2023年

作者： He, Yong Yu, Hongshan Yang, Zhengeng Sun, Wei Feng, Mingtao Mian, Ajmal The National Engineering Laboratory for Robot Visual Perception and Control Technology College of Electrical and Information Engineering Hunan University Lushan South Rd. Yuelu Dist. Changsha410082 China The School of Computer Science and Technology Xidian University Xi’an710071 China The Department of Computer Science The University of Western Australia PerthWA6009 Australia

Local features and contextual dependencies are crucial for 3D point cloud analysis. Many works have been devoted to designing better local convolutional kernels that exploit the contextual dependencies. However, current point convolutions lack robustness to varying point cloud density. Moreover, contextual modeling is dominated by non-local or self-attention models which are computationally expensive. To solve these problems, we propose density adaptive convolution, coined DAConv. The key idea is to adaptively learn the convolutional weights from geometric connections obtained from the point density and position. To extract precise context dependencies with fewer computations, we propose an interactive attention module (IAM) that embeds spatial information into channel attention along different spatial directions. DAConv and IAM are integrated in a hierarchical network architecture to achieve local density and contextual direction-aware learning for point cloud analysis. Experiments show that DAConv is significantly more robust to point density compared to existing methods and extensive comparisons on challenging 3D point cloud datasets show that our network achieves state-of-the-art classification results of 93.6% on ModelNet40, competitive semantic segmentation results of 68.71% mIoU on S3DIS and part segmentation results of 86.7% mIoU on ShapeNet. Copyright © 2023, The Authors. All rights reserved.

关键词： Convolution

来源：评论

学校读者我要写书评

暂无评论

Decentralized Trajectory Planning for Formation Flight in Unknown and Dense Environments

Decentralized Trajectory Planning for Formation Flight in Un...

引用

IEEE/RSJ International Conference on Intelligent robots and Systems (IROS)

作者： Jianxin Zeng Yaonan Wang Zhiqiang Miao Wei He Hesheng Wang Department of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Visual Perception and Control Changsha China School of Intelligence Science and Technology University of Science and Technology Beiing Beijing China Key Laboratory of Intelligent Bionic Unmanned Systems Ministry of Education University of Science and Technology Beijing Beijing China Department of Automation Shanghai Jiao Tong University Shanghai China

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

For aerial swarms, formation flight has been applied in various scenes. However, most existing works do not consider balancing the conflicting requirements among keeping formation, keeping the smoothness of trajectories, and obstacle avoidance within the limited time. To address this issue, we propose a decentralized trajectory planning framework for formation flight in unknown and dense environments. To ensure that feasible trajectories can be found within the limited time, the formation optimization problem is decoupled into formation affine transformation and iterative trajectory generation. Firstly, the optimization problem based on affine transformation is designed to obtain the optimal affine transformation sequence, which provides the formation reference of trajectory optimization. Secondly, the iterative optimization framework of trajectory planning is designed, which balances the conflicting requirements of formation, smooth flight, and obstacle avoidance. Besides, to escape the local minima caused by non-convex dense environments, the method of topological path planning is designed to provide distinctive initial solutions for trajectory optimization. Finally, the proposed methods are proven to be effective through the simulations and real-world experiments.

关键词： Trajectory planning Planning Iterative methods Collision avoidance Trajectory optimization Intelligent robots

来源：评论

学校读者我要写书评

暂无评论

FocusFlow: Boosting Key-Points Optical Flow Estimation for Autonomous Driving

arXiv

引用

arXiv 2023年

作者： Yi, Zhonghua Shi, Hao Yang, Kailun Jiang, Qi Ye, Yaozu Wang, Ze Ni, Huajian Wang, Kaiwei The State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China The School of Robotics Hunan University Changsha410012 China The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China Shanghai SUPREMIND Technology Company Ltd. Shanghai201210 China

Key-point-based scene understanding is fundamental for autonomous driving applications. At the same time, optical flow plays an important role in many vision tasks. However, due to the implicit bias of equal attention on all points, classic data-driven optical flow estimation methods yield less satisfactory performance on key points, limiting their implementations in key-point-critical safety-relevant scenarios. To address these issues, we introduce a points-based modeling method that requires the model to learn key-point-related priors explicitly. Based on the modeling method, we present FocusFlow, a framework consisting of 1) a mix loss function combined with a classic photometric loss function and our proposed Conditional Point control Loss (CPCL) function for diverse point-wise supervision;2) a conditioned controlling model which substitutes the conventional feature encoder by our proposed Condition control Encoder (CCE). CCE incorporates a Frame Feature Encoder (FFE) that extracts features from frames, a Condition Feature Encoder (CFE) that learns to control the feature extraction behavior of FFE from input masks containing information of key points, and fusion modules that transfer the controlling information between FFE and CFE. Our FocusFlow framework shows outstanding performance with up to +44.5% precision improvement on various key points such as ORB, SIFT, and even learning-based SiLK, along with exceptional scalability for most existing data-driven optical flow methods like PWC-Net, RAFT, and FlowFormer. Notably, FocusFlow yields competitive or superior performances rivaling the original models on the whole frame. The source code will be available at https://***/ZhonghuaYi/FocusFlow_official. Copyright © 2023, The Authors. All rights reserved.

关键词： Autonomous vehicles

来源：评论

学校读者我要写书评

暂无评论

Multi-Agent Path Finding Using Imitation-Reinforcement Learning with Transformer

Multi-Agent Path Finding Using Imitation-Reinforcement Learn...

引用

IEEE International Conference on robotics and Biomimetics

作者： Lin Chen Yaonan Wang Zhiqiang Miao Yang Mo Mingtao Feng Zhen Zhou School of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Visual Perception and Control Technology Changsha China School of Computer Science and Technology Xidian University Xian China

ISBN: (纸本)9781665481106

Multi-Agent Path Finding is a problem of finding the optimal set of paths for multiple agents from the starting position to the goal without conflict, which is essential to large-scale robotic systems. Imitation and reinforcement learning are applied to solve the MAPF problem and have achieved certain results, which provides a feasible solution for the path planning problem of large-scale robot systems. The current method improves the performance of distributed strategy-guided agent planning paths in complex environments by introducing the communication between graph neural networks and agents but dramatically reduces the system's robustness. This paper develops a novel imitation reinforcement learning framework by introducing Transformer, which enables algorithms to perform well in complex environments without relying on communication between agents. Compared with its counterparts, experiments show that the policy trained by our method guides the agent to drive from the initial position to the goal without collision and achieve better performance.

关键词： Learning systems robot kinematics Biomimetics Reinforcement learning Transformers Robustness Path planning

来源：评论

学校读者我要写书评

暂无评论

Exploring Event-based Human Pose Estimation with 3D Event Representations

arXiv

引用

arXiv 2023年

作者： Yin, Xiaoting Shi, Hao Chen, Jiaan Wang, Ze Ye, Yaozu Yang, Kailun Wang, Kaiwei State Key Laboratory of Extreme Photonics and Instrumentation Zhejiang University Hangzhou310027 China School of Robotics Hunan University Changsha410012 China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China Shanghai SUPREMIND Technology Company Ltd. Shanghai201210 China

Human pose estimation is a fundamental and appealing task in computer vision. Although traditional cameras are commonly applied, their reliability decreases in scenarios under high dynamic range or heavy motion blur, where event cameras offer a robust solution. Predominant event-based methods accumulate events into frames, ignoring the asynchronous and high temporal resolution that is crucial for distinguishing distinct actions. To address this issue and to unlock the 3D potential of event information, we introduce two 3D event representations: the Rasterized Event Point Cloud (RasEPC) and the Decoupled Event Voxel (DEV). The RasEPC aggregates events within concise temporal slices at identical positions, preserving their 3D attributes along with statistical information, thereby significantly reducing memory and computational demands. Meanwhile, the DEV representation discretizes events into voxels and projects them across three orthogonal planes, utilizing decoupled event attention to retrieve 3D cues from the 2D planes. Furthermore, we develop and release EV-3DPW, a synthetic event-based dataset crafted to facilitate training and quantitative analysis in outdoor scenes. Our methods are tested on the DHP19 public dataset, MMHPSD dataset, and our EV-3DPW dataset, with further qualitative validation via a derived driving scene dataset EV–JAAD and an outdoor collection vehicle. Our code and dataset have been made publicly available at https://***/MasterHow/EventPointPose. Copyright © 2023, The Authors. All rights reserved.

关键词： 3D modeling

来源：评论

学校读者我要写书评

暂无评论

Memory-augment convolutional Autoencoder for unsupervised pavement crack classification

Memory-augment convolutional Autoencoder for unsupervised pa...

引用

2021 China Automation Congress, CAC 2021

作者： Wu, Tianyue Zhang, Hui Liu, Jiaxuan Chen, Yurong Yi, Junfei Zhang, Zouquan School of Electrical and Information Engineering Changsha University of Science and Technology Changsha China School of Robotics also with Visual Perception and Control Technology National Engineering Laboratory Hunan University Changsha China School of Electrical and Information Engineering Hunan University Changsha China

ISBN: (纸本)9781665426473

In urban construction, transportation system is an important part. However, the pavement cracks will occur because of using in long time and some external force collision, which has impacts on the safety and reliability of the whole transportation system. Therefore, it is necessary to detect the pavement cracks. The formation of pavement cracks is slow, and it is not concentrated on one place, so it is difficult to obtain enough images containing cracks to train. We propose a new pre-training method based on self-supervision study, which can obtain features closer to the target task from normal pavement images. In addition, we combine a memory-augment convolutional autoencoder and a hard-threshold module to improve the accuracy of the crack classification. Experiments conducted on the Mendeley Concrete crack dataset and DeepCrack dataset demonstrate the good performance in pavement crack classification task. © 2021 IEEE

关键词： Learning systems

来源：评论

学校读者我要写书评

暂无评论

Safety-Critical control of Quadrotor UAVs with control Barrier Functions

Safety-Critical Control of Quadrotor UAVs with Control Barri...

引用

IEEE International Conference on robotics and Biomimetics

作者： Tianyi Yang Zhiqiang Miao Guo Yi Yaonan Wang College of Electrical and Information Engineering Hunan University Chang-sha China National Engineering Research Center of Robot Visual Perception and Control Changsha China School of Information and Electrical Engineering Hunan University of Science and Technology Changsha China

ISBN: (纸本)9781665481106

For quadrotors, imposing multiple dynamic constraints on the state simultaneously to achieve safe control is a challenging problem. In this paper, a cascaded control archi-tecture based on quadratic programming method is proposed to generate minimally-invasive and collision-free control actions. This architecture consists of exponential control barrier functions(ECBFs) to construct a non-conservative forward invariant safety region and geometric nonlinear PID attitude control with considering quadrotor dynamics to avoid the singularities of Euler-angles and the ambiguity of quaternions. The feasibility and the effectiveness of the proposed cascaded control architecture is demonstrated through numerical simulations.

关键词： Attitude control Quaternions Biomimetics Numerical simulation Safety Quadratic programming robots

来源：评论

学校读者我要写书评

暂无评论

Representing Domain-Mixing Optical Degradation for Real-World Computational Aberration Correction via Vector Quantization

arXiv

引用

arXiv 2024年

作者： Jiang, Qi Yi, Zhonghua Gao, Shaohua Gao, Yao Qian, Xiaolong Shi, Hao Sun, Lei Niu, JinXing Wang, Kaiwei Yang, Kailun Bai, Jian State Key Laboratory of Extreme Photonics and Instrumentation College of Optical Science and Engineering Zhejiang University Hangzhou310027 China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China Intelligent Optics & Photonics Research Center Jiaxing Research Institute Zhejiang University Jiaxing314031 China School of Mechanical Engineering North China University of Water Resources and Electric Power Zhenzhou450045 China

Relying on paired synthetic data, existing learning-based Computational Aberration Correction (CAC) methods are confronted with the intricate and multifaceted synthetic-to-real domain gap, which leads to suboptimal performance in real-world applications. In this paper, in contrast to improving the simulation pipeline, we deliver a novel insight into real-world CAC from the perspective of Unsupervised Domain Adaptation (UDA). By incorporating readily accessible unpaired real-world data into training, we formalize the Domain Adaptive CAC (DACAC) task, and then introduce a comprehensive Real-world aberrated images (Realab) dataset to benchmark it. The setup task presents a formidable challenge due to the intricacy of understanding the target optical degradation domain. To this intent, we propose a novel Quantized Domain-Mixing Representation (QDMR) framework as a potent solution to the issue. Centering around representing and quantizing the optical degradation which is consistent across different images, QDMR adapts the CAC model to the target domain from three key aspects: (1) reconstructing aberrated images of both domains by a VQGAN to learn a Domain-Mixing Codebook (DMC) characterizing the optical degradation;(2) modulating the deep features in CAC model with DMC to transfer the target domain knowledge;and (3) leveraging the trained VQGAN to generate pseudo target aberrated images from the source ones for convincing target domain supervision. Extensive experiments on both synthetic and real-world benchmarks reveal that the models with QDMR consistently surpass the competitive methods in mitigating the synthetic-to-real gap, which produces visually pleasant real-world CAC results with fewer artifacts. Codes and datasets are made publicly available at https://***/zju-jiangqi/QDMR. Copyright © 2024, The Authors. All rights reserved.

关键词： Vector quantization

来源：评论

学校读者我要写书评

暂无评论

Tackling Real-world Complexity: Hierarchical Modeling and Dynamic Prompting for Multimodal Long Document Classification

引用

IEEE Transactions on Circuits and Systems for Video Technology 2025年第6期35卷 5776-5790页

作者： Liu, Tengfei Hu, Yongli Li, Mingjie Yi, Junfei Chang, Xiaojun Gao, Junbin Yin, Baocai Beijing University of Technology Beijing Key Laboratory of Multimedia and Intelligent Software Technology Beijing Institute of Artificial Intelligence School of Information Science and Technology Beijing100124 China Stanford University Department of Radiation Oncology StanfordCA94305 United States Hunan University National Engineering Laboratory of Robot Visual Perception and Control Technology College of Electrical and Information Engineering Hunan Changsha410082 China University of Technology Sydney ReLER Laboratory Australian Artificial Intelligence Institute Faculty of Engineering and Information Technology UltimoNSW2007 Australia The University of Sydney Business School The University of Sydney Discipline of Business Analytics CamperdownNSW2006 Australia

With the rapid growth of internet content, multimodal long document data has become increasingly prominent, drawing significant attention from researchers. However, most existing methods primarily focus on scenarios where all modalities are present, often overlooking more challenging and realistic cases involving missing image modality. To address this limitation, we propose a robust multimodal long document classification (MLDC) framework that integrates hierarchical modeling and dynamic prompting to handle complex multimodal long document data. Our approach begins by leveraging hierarchical modeling combined with an Adaptive Correlation Multimodal Transformer (ACMT) to effectively capture relationships between text and images at both section and sentence levels. We also introduce a Dynamic Prompt Generation (DPG) module at both levels to enhance the model's robustness in handling missing image data. By evaluating sample uncertainty, the DPG module dynamically adjusts both the number of prompts and the prompts themselves, allowing the model to better adapt to the varying needs of different samples. Finally, a Hierarchical Heterogeneous Graph (HHG) is introduced to enhance feature interactions across levels, further improving the coherence and accuracy of the model. Extensive experiments on four multi-modal long document datasets demonstrate that our model shows superior performance compared to existing state-of-the-art MLDC classification methods in various conditions. © 1991-2012 IEEE.

关键词： dynamic prompt generation hierarchical heterogeneous graph Multimodal long document classification

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：