Interactive Image Segmentation (IIS) has emerged as a promising technique for decreasing annotation time. Substantial progress has been made in pre- and post-processing for IIS, but the critical issue of interaction a...
详细信息
In this article, an robust nonlinear observer-based visual servo adaptive control strategy is investigated for a multirotor for stable tracking of targets. This article uses the Newton Euler equation to model the dyna...
详细信息
ISBN:
(数字)9798350372601
ISBN:
(纸本)9798350372618
In this article, an robust nonlinear observer-based visual servo adaptive control strategy is investigated for a multirotor for stable tracking of targets. This article uses the Newton Euler equation to model the dynamics of the multirotor and describes the visual servo system model. In order to avoid being affected by various disturbances, this article designs disturbance observer and velocity observer to improve the robustness of the system. Based on nonlinear observers, this article designs a layered controller that includes a visual outer loop controller and an adaptive sliding mode geometric inner loop controller. To verify the feasibility of this algorithm, this article conducts simulation experiments using MATLAB and Simulink, and adds constant disturbances for verification. Both simulation experiments and experimental results in real environments show that the controller we designs has excellent stability and robustness.
People with visual Impairments (PVI) typically recognize objects through haptic perception. Knowing objects and materials before touching is desired by the target users but under-explored in the field of human-centere...
详细信息
Relying on paired synthetic data, existing learning-based Computational Aberration Correction (CAC) methods are confronted with the intricate and multifaceted synthetic-to-real domain gap, which leads to suboptimal pe...
详细信息
This paper presents a learning-based high-speed trajectory tracking control strategy for quadrotors, which achieves efficient learning and strong reliability by the collaboration of deep reinforcement learning (RL) an...
详细信息
ISBN:
(数字)9798350379228
ISBN:
(纸本)9798350390780
This paper presents a learning-based high-speed trajectory tracking control strategy for quadrotors, which achieves efficient learning and strong reliability by the collaboration of deep reinforcement learning (RL) and self-tuning mechanism. Different from existing methods, the proposed strategy is designed to explore optimal control performance by taking advantage of model-based self-tuning mechanism and deep reinforcement learning. Specifically, the self-tuning guided deep RL scheme is put forward for quadrotors, with superior learning efficiency and strong adaptability. Firstly, a novel self-tuning mechanism is constructed and some auxiliary variables are introduced to enhance the tracking performance. Then, based on the model-driven self-tuning design, the deep RL is proposed to achieve model-guided learning, where the tuning actions are adopted in the evaluation process during training, aiming at removing the bad explorations by the carefully designed parallel evaluation. Finally, the convergence is analyzed based on the proposed learning framework, which indicates the efficient cooperation of exploration and self-tuning mechanism. To verify the effectiveness of the proposed controller, the guided training and hardware experiments are implemented to show efficient cooperation and satisfactory high-speed trajectory tracking control of the proposed method.
Nine-degrees-of-freedom (9-DoF) object pose and size estimation is crucial for enabling augmented reality and robotic manipulation. Category-level methods have received extensive research attention due to their potent...
详细信息
Nine-degrees-of-freedom (9-DoF) object pose and size estimation is crucial for enabling augmented reality and robotic manipulation. Category-level methods have received extensive research attention due to their potential for generalization to intra-class unknown objects. However, these methods require manual collection and labeling of large-scale real-world training data. To address this problem, we introduce a diffusion-based paradigm for domain-generalized category-level 9-DoF object pose estimation. Our motivation is to leverage the latent generalization ability of the diffusion model to address the domain generalization challenge in object pose estimation. This entails training the model exclusively on rendered synthetic data to achieve generalization to real-world scenes. We propose an effective diffusion model to redefine 9-DoF object pose estimation from a generative perspective. Our model does not require any 3D shape priors during training or inference. By employing the Denoising Diffusion Implicit Model, we demonstrate that the reverse diffusion process can be executed in as few as 3 steps, achieving near real-time performance. Finally, we design a robotic grasping system comprising both hardware and software components. Through comprehensive experiments on two benchmark datasets and the real-world robotic system, we show that our method achieves state-of-the-art domain generalization performance.
Transformer-based methods have demonstrated superior performance for monocular 3D object detection recently, which aims at predicting 3D attributes from a single 2D image. Most existing transformer-based methods lever...
详细信息
For quadrotors, imposing multiple dynamic constraints on the state simultaneously to achieve safe control is a challenging problem. In this paper, a cascaded control archi-tecture based on quadratic programming method...
详细信息
ISBN:
(纸本)9781665481106
For quadrotors, imposing multiple dynamic constraints on the state simultaneously to achieve safe control is a challenging problem. In this paper, a cascaded control archi-tecture based on quadratic programming method is proposed to generate minimally-invasive and collision-free control actions. This architecture consists of exponential control barrier functions(ECBFs) to construct a non-conservative forward invariant safety region and geometric nonlinear PID attitude control with considering quadrotor dynamics to avoid the singularities of Euler-angles and the ambiguity of quaternions. The feasibility and the effectiveness of the proposed cascaded control architecture is demonstrated through numerical simulations.
For aerial swarms, formation flight has been applied in various scenes. However, most existing works do not consider balancing the conflicting requirements among keeping formation, keeping the smoothness of trajectori...
详细信息
ISBN:
(数字)9798350377705
ISBN:
(纸本)9798350377712
For aerial swarms, formation flight has been applied in various scenes. However, most existing works do not consider balancing the conflicting requirements among keeping formation, keeping the smoothness of trajectories, and obstacle avoidance within the limited time. To address this issue, we propose a decentralized trajectory planning framework for formation flight in unknown and dense environments. To ensure that feasible trajectories can be found within the limited time, the formation optimization problem is decoupled into formation affine transformation and iterative trajectory generation. Firstly, the optimization problem based on affine transformation is designed to obtain the optimal affine transformation sequence, which provides the formation reference of trajectory optimization. Secondly, the iterative optimization framework of trajectory planning is designed, which balances the conflicting requirements of formation, smooth flight, and obstacle avoidance. Besides, to escape the local minima caused by non-convex dense environments, the method of topological path planning is designed to provide distinctive initial solutions for trajectory optimization. Finally, the proposed methods are proven to be effective through the simulations and real-world experiments.
In this paper, we propose LF-PGVIO, a visual-Inertial-Odometry (VIO) framework for large Field-of-View (FoV) cameras with a negative plane using points and geodesic segments. The purpose of our research is to unleash ...
详细信息
暂无评论