检索结果-内蒙古大学图书馆

IEEE International Conference on robotics and Automation (ICRA)

作者： Junwei Zheng Jiaming Zhang Kailun Yang Kunyu Peng Rainer Stiefelhagen Institute for Robotics and Anthropomatics Karlsruhe Institute of Technology Karlsruhe Germany Department of Engineering Science University of Oxford UK School of Robotics and the National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China

ISBN: (数字)9798350384574

ISBN: (纸本)9798350384581

People with visual Impairments (PVI) typically recognize objects through haptic perception. Knowing objects and materials before touching is desired by the target users but under-explored in the field of human-centered robotics. To fill this gap, in this work, a wearable vision-based robotic system, MATErobot, is established for PVI to recognize materials and object categories beforehand. To address the computational constraints of mobile platforms, we propose a lightweight yet accurate model MATEViT to perform pixel-wise semantic segmentation, simultaneously recognizing both objects and materials. Our methods achieve respective 40.2% and 51.1% of mIoU on COCOStuff-10K and DMS datasets, surpassing the previous method with +5.7% and +7.0% gains. Moreover, on the field test with participants, our wearable system reaches a score of 28 in the NASA-Task Load Index, indicating low cognitive demands and ease of use. Our MATErobot demonstrates the feasibility of recognizing material property through visual cues and offers a promising step towards improving the functionality of wearable robots for PVI. The source code has been made publicly available at MATErobot.

关键词： visualization Source coding Semantic segmentation visual impairment Semantics Wearable robots Mobile applications

来源：评论

学校读者我要写书评

暂无评论

Geometric-based Bimodal control for Hybrid Aerial/Ground Vehicles

Geometric-based Bimodal Control for Hybrid Aerial/Ground Veh...

引用

IEEE International Conference on Real-time Computing and robotics (RCAR)

作者： Haoming Tang Zhiqiang Miao Haoyu Wang Yizong Chen Hui Zhang Yaonan Wang College of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Visual Perception and Control Changsha China School of Robotics Hunan University Changsha China

ISBN: (数字)9798350372601

ISBN: (纸本)9798350372618

Hybrid ground/aerial vehicles, capable of adapting to both terrestrial and aerial environments simultaneously, can accomplish more complex tasks, holding promising applications across various domains. Furthermore, designing a highly real-time multi-modal controller to adapt to environmental and modal changes, is currently a critical issue to be addressed. Based on this requirement, a geometric-based bimodal control structure is proposed in this study. We initially design the aerial controller in the Lie algebra space, based on a geometric attitude controller. Moreover, inspired by the characteristics of ground locomotion, we modify the aerial controller to satisfy the constraints of this mode. Through this approach, we can simplify the design process of the ground controller. Both controllers feature a similar and simpler structure, meet real-time control requirements, and allow them to use the same parameters. Ultimately, the proposed method’s efficacy and performance are validated through ROS-Gazebo simulation environment.

关键词： Attitude control Algebra Trajectory tracking Process control Aerospace electronics Real-time systems Motion control

来源：评论

学校读者我要写书评

暂无评论

Safety-Critical control of Quadrotor UAVs with control Barrier Functions

Safety-Critical Control of Quadrotor UAVs with Control Barri...

引用

IEEE International Conference on robotics and Biomimetics

作者： Tianyi Yang Zhiqiang Miao Guo Yi Yaonan Wang College of Electrical and Information Engineering Hunan University Chang-sha China National Engineering Research Center of Robot Visual Perception and Control Changsha China School of Information and Electrical Engineering Hunan University of Science and Technology Changsha China

ISBN: (纸本)9781665481106

For quadrotors, imposing multiple dynamic constraints on the state simultaneously to achieve safe control is a challenging problem. In this paper, a cascaded control archi-tecture based on quadratic programming method is proposed to generate minimally-invasive and collision-free control actions. This architecture consists of exponential control barrier functions(ECBFs) to construct a non-conservative forward invariant safety region and geometric nonlinear PID attitude control with considering quadrotor dynamics to avoid the singularities of Euler-angles and the ambiguity of quaternions. The feasibility and the effectiveness of the proposed cascaded control architecture is demonstrated through numerical simulations.

关键词： Attitude control Quaternions Biomimetics Numerical simulation Safety Quadratic programming robots

来源：评论

学校读者我要写书评

暂无评论

Admittance Based robot Force control Framework for Server Board Assembly 25

Admittance Based Robot Force Control Framework for Server Bo...

引用

25th IEEE International Conference on Industrial technology, ICIT 2024

作者： Ma, Yunlong Wang, Yaonan Jiang, Yiming Zhou, Xianen Zhu, Ge Zhu, Qing Institute of Artificial Intelligence University of Science and Technology Beijing Beijing China Xiangjiang Laboratory Hunan China College of Electrical and Information Engineering Hunan University Changsha China School of Robotics Hunan University Changsha China National Engineering Research Center for Robot Vision Perception and Control Technology Hunan University Changsha China ZTE Corporation Shenzhen China

In server board assembly tasks, the effect of vision-based robot assembly schemes is not ideal due to the small installation gap and the blocking of vision. Adding force sensors and force controllers can be a good solution to the above problems and increase the flexibility in the assembly process. In this paper, we propose a force control strategy applied to a server board assembly task. The method is divided into two main parts. In the first part, the zero offset of the force sensor and the load gravity are calibrated and compensated, so that the external force on the load is accurately obtained. In the second part, the admittance controller is designed to achieve compliant behavior between the robot and the environment. Finally, the experimental verification of the board insertion is carried out on the experimental platform. Experimental results verify the effectiveness and practicability of the proposed method. © 2024 IEEE.

关键词： controllers

来源：评论

学校读者我要写书评

暂无评论

Minimalist and High-Quality Panoramic Imaging with PSF-aware Transformers

arXiv

引用

arXiv 2023年

作者： Jiang, Qi Gao, Shaohua Gao, Yao Yang, Kailun Yi, Zhonghua Shi, Hao Sun, Lei Wang, Kaiwei The State Key Laboratory of Modern Optical Instrumentation The National Engineering Research Center of Optical Instrumentation Zhejiang University Hangzhou310027 China The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China

High-quality panoramic images with a Field of View (FoV) of 360° are essential for contemporary panoramic computer vision tasks. However, conventional imaging systems come with sophisticated lens designs and heavy optical components. This disqualifies their usage in many mobile and wearable applications where thin and portable, minimalist imaging systems are desired. In this paper, we propose a Panoramic Computational Imaging Engine (PCIE) to achieve minimalist and high-quality panoramic imaging. With less than three spherical lenses, a Minimalist Panoramic Imaging Prototype (MPIP) is constructed based on the design of the Panoramic Annular Lens (PAL), but with low-quality imaging results due to aberrations and small image plane size. We propose two pipelines, i.e. Aberration Correction (AC) and Super-Resolution and Aberration Correction (SR&AC), to solve the image quality problems of MPIP, with imaging sensors of small and large pixel size, respectively. To leverage the prior information of the optical system, we propose a Point Spread Function (PSF) representation method to produce a PSF map as an additional modality. A PSF-aware Aberration-image Recovery Transformer (PART) is designed as a universal network for the two pipelines, in which the self-attention calculation and feature extraction are guided by the PSF map. We train PART on synthetic image pairs from simulation and put forward the PALHQ dataset to fill the gap of real-world high-quality PAL images for low-level vision. A comprehensive variety of experiments on synthetic and real-world benchmarks demonstrates the impressive imaging results of PCIE and the effectiveness of the PSF representation. We further deliver heuristic experimental findings for minimalist and high-quality panoramic imaging, in terms of the choices of prototype and pipeline, network architecture, training strategies, and dataset construction. Our dataset and code will be available at https://***/zju-jiangqi/PCIE-PART. Copyrig

关键词： Optical transfer function

来源：评论

学校读者我要写书评

暂无评论

OAFuser: Towards Omni-Aperture Fusion for Light Field Semantic Segmentation

arXiv

引用

arXiv 2023年

作者： Teng, Fei Zhang, Jiaming Peng, Kunyu Wang, Yaonan Stiefelhagen, Rainer Yang, Kailun The School of Robotics The National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China The Institute for Anthropomatics and Robotics Karlsruhe Institute of Technology Karlsruhe76131 Germany The Institute for Visual Computing ETH Zurich Zurich8092 Switzerland

Light field cameras are capable of capturing intricate angular and spatial details. This allows for acquiring complex light patterns and details from multiple angles, significantly enhancing the precision of image semantic segmentation. However, two significant issues arise: (1) The extensive angular information of light field cameras contains a large amount of redundant data, which is overwhelming for the limited hardware resources of intelligent agents. (2) A relative displacement difference exists in the data collected by different micro-lenses. To address these issues, we propose an Omni-Aperture Fusion model (OAFuser) that leverages dense context from the central view and extracts the angular information from sub-aperture images to generate semantically consistent results. To simultaneously streamline the redundant information from the light field cameras and avoid feature loss during network propagation, we present a simple yet very effective Sub-Aperture Fusion Module (SAFM). This module efficiently embeds sub-aperture images in angular features, allowing the network to process each sub-aperture image with a minimal computational demand of only (∼1GFlops). Furthermore, to address the mismatched spatial information across viewpoints, we present a center Angular Rectification Module (CARM) to realize feature resorting and prevent feature occlusion caused by misalignment. The proposed OAFuser achieves state-of-the-art performance on four UrbanLF datasets in terms of all evaluation metrics and sets a new record of 84.93% in mIoU on the UrbanLF-Real Extended dataset, with a gain of +3.69%. The source code for OAFuser is available at https://***/FeiBryantkit/OAFuser. Impact Statement-To solve the data abundance problem, we have reduced the significant computational consumption of light field cameras while not introducing any additional parameters. The proposed method has practical value for the deployment and application of light field cameras. The proposed

关键词： Semantic Segmentation

来源：评论

学校读者我要写书评

暂无评论

Skeleton-Based Human Action Recognition with Noisy Labels

Skeleton-Based Human Action Recognition with Noisy Labels

引用

IEEE/RSJ International Conference on Intelligent robots and Systems (IROS)

作者： Yi Xu Kunyu Peng Di Wen Ruiping Liu Junwei Zheng Yufan Chen Jiaming Zhang Alina Roitberg Kailun Yang Rainer Stiefelhagen Anthropomatics and Robotics Karlsruhe Institute of Technology Germany Institute for Artificial Intelligence University of Stuttgart Germany School of Robotics Hunan University China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University China

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Understanding human actions from body poses is critical for assistive robots sharing space with humans in order to make informed and safe decisions about the next interaction. However, precise temporal localization and annotation of activity sequences is time-consuming and the resulting labels are often noisy. If not effectively addressed, label noise negatively affects the model’s training, resulting in lower recognition quality. Despite its importance, addressing label noise for skeleton-based action recognition has been overlooked so far. In this study, we bridge this gap by implementing a framework that augments well-established skeleton-based human action recognition methods with label-denoising strategies from various research areas to serve as the initial benchmark. Observations reveal that these baselines yield only marginal performance when dealing with sparse skeleton data. Consequently, we introduce a novel methodology, NoiseEraSAR, which integrates global sample selection, co-teaching, and Cross-Modal Mixture-of-Experts (CM-MOE) strategies, aimed at mitigating the adverse impacts of label noise. Our proposed approach demonstrates better performance on the established benchmark, setting new state-of-the-art standards. The source code for this study will be made accessible at https://***/xuyizdby/NoiseEraSAR.

关键词： Training Source coding Noise Training data Benchmark testing Skeleton Noise measurement Human activity recognition Streams Standards

来源：评论

学校读者我要写书评

暂无评论

L₁ Adaptive control-Based Formation Tracking of Multiple Quadrotors Without Linear Velocity Feedback Under Unknown Disturbances

引用

IEEE Transactions on Automation Science and engineering 2024年 22卷 5804-5815页

作者： Yang Hu Zhiqiang Miao Yaonan Wang Haoming Tang Xiangke Wang Wei He College of Electrical and Information Engineering Hunan University Changsha China National Engineering Research Center for Robot Visual Perception and Control Changsha China College of Intelligence Science and Technology National University of Defense Technology Changsha China School of Intelligence Science and Technology and the Key Laboratory of Intelligent Bionic Unmanned Systems Ministry of Education University of Science and Technology Beijing Beijing China

This paper addresses the problem of formation control for a quadrotor swarm (QS) system with directed graph topology under external environmental disturbances and unreliable internal state acquisition. The proposed distributed robust control framework, based on a gemetric controller, incorporates ${\mathcal {L}}_control$ adaptive controllers and differentiator systems. First, the geometric formation controller is designed to implement the formation control of the nominal system. Then, ${\mathcal {L}}_control$ adaptive controllers are designed separately for each quadrotor’s position loop and attitude loop subsystems to address the effects of uncertainties such as external time-varying disturbances (matched and unmatched disturbances) and different mass variations of quadrotors. Furthermore, the differentiator system is devised to accurately estimate the higher-order derivatives of the non-directly-measurable velocity information and the virtual translation control signal, which enhances system accuracy while reducing computational complexity. The Lyapunov stability theory is employed to analyze the stability of the closed-loop system. Finally, the effectiveness and exceptional performance of this approach in QS formation control were validated through numerical simulation and experimental results. Note to Practitioners—The inspiration for this article comes from the issue of formation control in a cluster of quadrotor drones, which is also applicable to formation control in other types of drones. In this paper, a formation control algorithm based on ${\mathcal {L}}_control$ adaptive control strategy and arbitrary-order differentiation is designed. This algorithm can address not only the issue of time-varying wind disturbances frequently encountered during quadrotor drone flights but also the effects of unpredictable velocities and inconsistent masses of quadrotor drones. The disturbance rejection capability of this scheme enables quadrotor drones to be applied more safely and r

关键词： Quadrotors Formation control Adaptive control Topology Drones Autonomous aerial vehicles Uncertainty

来源：评论

学校读者我要写书评

暂无评论

LF-PGVIO: A visual-Inertial-Odometry Framework for Large Field-of-View Cameras using Points and Geodesic Segments

IEEE Transactions on Intelligent Vehicles

引用

IEEE Transactions on Intelligent Vehicles 2024年 1-13页

作者： Wang, Ze Yang, Kailun Shi, Hao Zhang, Yufan Xu, Zhijie Gao, Fei Wang, Kaiwei State Key Laboratory of Extreme Photonics and Instrumentation School of Robotics and the National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha China School of Computing and Engineering University of Huddersfield Huddersfield U.K State Key Laboratory of Industrial Control Technology Zhejiang University Hangzhou China

In this paper, we propose LF-PGVIO, a visual-Inertial-Odometry (VIO) framework for large Field-of-View (FoV) cameras with a negative plane using points and geodesic segments. The purpose of our research is to unleash the potential of point-line odometry with large-FoV omnidirectional cameras, even for cameras with negative-plane FoV. To achieve this, we propose an Omnidirectional Curve Segment Detection (OCSD) method combined with a camera model which is applicable to images with large distortions, such as panoramic annular images, fisheye images, and various panoramic images. The geodesic segment is sliced into multiple straight-line segments based on the radian and descriptors are extracted and recombined. Descriptor matching establishes the constraint relationship between 3D line segments in multiple frames. In our VIO system, line feature residual is also extended to support large-FoV cameras. Extensive evaluations on public datasets demonstrate the superior accuracy and robustness of LF-PGVIO compared to state-of-the-art methods. The source code will be made publicly available at https://***/flysoaryun/LF-PGVIO. IEEE

关键词： Feature extraction

来源：评论

学校读者我要写书评

暂无评论

A Flexible Framework for Universal Computational Aberration Correction via Automatic Lens Library Generation and Domain Adaptation

arXiv

引用

arXiv 2024年

作者： Jiang, Qi Gao, Yao Gao, Shaohua Yi, Zhonghua Sun, Lei Shi, Hao Yang, Kailun Wang, Kaiwei Bai, Jian State Key Laboratory of Extreme Photonics and Instrumentation College of Optical Science and Engineering Zhejiang University Hangzhou310027 China National Engineering Research Center of Robot Visual Perception and Control Technology Hunan University Changsha410082 China

Emerging universal Computational Aberration Correction (CAC) paradigms provide an inspiring solution to light-weight and high-quality imaging without repeated data preparation and model training to accommodate new lens designs. However, the training databases in these approaches, i.e., the lens libraries (LensLibs), suffer from their limited coverage of real-world aberration behaviors. Moreover, it is challenging to train a universal model for reliable results in a zero-shot manner, whose inflexible tuning pipeline is also confined to the lens-descriptions-known case. In this work, we set up an OmniLens framework for universal CAC, considering both the generalization ability and flexibility. OmniLens extends the idea of universal CAC to a broader concept, where a base model is trained as the pre-trained model for three cases, including zero-shot CAC with the pre-trained model, few-shot CAC with a little lens-specific data for fine-tuning, and domain adaptive CAC using domain adaptation for lens-descriptions-unknown lens. In terms of OmniLens’s data foundation, we first propose an Evolution-based Automatic Optical Design (EAOD) pipeline to construct the LensLib automatically, coined AODLib, whose diversity is enriched by an evolution framework, with comprehensive constraints and a hybrid optimization strategy for achieving realistic aberration behaviors. For network design, we introduce the guidance of high-quality codebook priors to facilitate both zero-shot CAC and few-shot CAC, which enhances the model’s generalization ability, while also boosting its convergence in a few-shot case. Furthermore, based on the statistical observation of dark channel priors in optical degradation, we design an unsupervised regularization term to adapt the base model to the target descriptions-unknown lens using its aberration images without ground truth. We validate the proposed OmniLens framework on 4 manually designed low-end lenses with various structures and aberration behaviors.

关键词： Aberrations

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：