检索结果-内蒙古大学图书馆

Confidence-Aware Safe and Stable Control of Control-Affine Systems

学校读者我要写书评

暂无评论

Confidence-Aware Safe and Stable Control of Control-Affine S...

American Control Conference (ACC)

作者： Shiqing Wei Prashanth Krishnamurthy Farshad Khorrami Department of Electrical and Computer Engineering NYU Tandon Control/Robotics Research Laboratory School of Engineering 5 Metrotech Center Brooklyn NY USA

ISBN: (数字)9798350382655

ISBN: (纸本)9798350382662

Designing control inputs that satisfy safety requirements is crucial in safety-critical nonlinear control, and this task becomes particularly challenging when full-state measurements are unavailable. In this work, we address the problem of synthesizing safe and stable control for control-affine systems via output feedback (using an observer) while reducing the estimation error of the observer. To achieve this, we adapt control Lyapunov function (CLF) and control barrier function (CBF) techniques to the output feedback setting. Building upon the existing CLF-CBF-QP (Quadratic Program) and CBF-QP frameworks, we formulate two confidence-aware optimization problems and establish the Lipschitz continuity of the obtained solutions. To validate our approach, we conduct simulation studies on two illustrative examples. The simulation studies indicate both improvements in the observer's estimation accuracy and the fulfillment of safety and control requirements.

关键词： Accuracy Observers Control systems Eigenvalues and eigenfunctions Safety Trajectory Task analysis

Whole Body Balance Control for Bipedal Robots Based on Virtual Model Control 16th

学校读者我要写书评

暂无评论

Whole Body Balance Control for Bipedal Robots Based on Virtu...

16th International Conference on Intelligent robotics and Applications, ICIRA 2023

作者： Gao, Chengzhi Xie, Ye Zhu, Yiting Liang, Dingkun Kong, Lingyu Wang, Xin Xie, Anhuan Gu, Jianjun Research Center for Intelligent Robotics Research Institute of Interdisciplinary Innovation Zhejiang Laboratory Hangzhou311100 China Zhejiang Engineering Research Center for Intelligent Robotics Hangzhou311100 China Zhejiang University Zhejiang Hangzhou311100 China Department of Electrical and Computer Engineering Dalhousie University HalifaxNSB3H 4R2 Canada

ISBN: (纸本)9789819964918

Due to the lack of accurate stability theoretical basis, the dynamic balance control of bipedal robots is a challenging topic. In this paper, we propose a controller that combines virtual model control and whole body control. In our framework, the whole system is simplified into a spring inverted pendulum model. Decoupling control is carried out for this model, and a virtual model is introduced to establish the relationship between the joint torque of the support leg and the state of the center of mass. The distribution of reaction force is obtained through decoupling closed-loop control. The whole body control part first uses multi task whole body control to determine the kinematics information, and then solves the joint feedforward torque through dynamical model, thus obtaining the desired force position hybrid control. Proposed algorithm improved the problem of incomplete decoupling between states and increased the stiffness of the support leg. The newly designed control framework was tested in Simscape dynamic simulation and verified the anti-interference ability and fast walking ability of Whole Body Balance Control for bipedal robots based on Virtual Model Control. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd 2023.

关键词： Inverted pendulum

Active perception for grasp detection via neural graspness field 24

学校读者我要写书评

暂无评论

Active perception for grasp detection via neural graspness f...

Proceedings of the 38th International Conference on Neural Information Processing Systems

作者： Haoxiang Ma Modi Shi Boyang Gao Di Huang State Key Laboratory of Complex and Critical Software Environment School of Computer Science and Engineering Beihang University Beijing China Geometry Robotics

ISBN: (纸本)9798331314385

This paper tackles the challenge of active perception for robotic grasp detection in cluttered environments. Incomplete 3D geometry information can negatively affect the performance of learning-based grasp detection methods, and scanning the scene from multiple views introduces significant time costs. To achieve reliable grasping performance with efficient camera movement, we propose an active grasp detection framework based on the Neural Graspness Field (NGF), which models the scene incrementally and facilitates next-best-view planning. Constructed in real-time as the camera moves, the NGF effectively models the grasp distribution in 3D space by rendering graspness predictions from each view. For next-best-view planning, we aim to reduce the uncertainty of the NGF through a graspness inconsistency-guided policy, selecting views based on discrepancies between NGF outputs and a pre-trained graspness network. Additionally, we present a neural graspness sampling method that decodes graspness values from the NGF to improve grasp pose detection results. Extensive experiments on the GraspNet-1Billion benchmark demonstrate significant performance improvements compared to previous works. Real-world experiments show that our method achieves a superior trade-off between grasping performance and time costs. Code is available at https://***/mahaoxiang822/ActiveNGF.

关键词：

Brain-Conditional Multimodal Synthesis: A Survey and Taxonomy

学校读者我要写书评

暂无评论

IEEE Transactions on Artificial Intelligence

IEEE Transactions on Artificial Intelligence 2025年第5期6卷 1080-1099页

作者： Mai, Weijian Zhang, Jian Fang, Pengfei Zhang, Zhijun South China University of Technology School of Automation Science and Engineering Guangzhou510640 China Southeast University School of Computer Science and Engineering Nanjing210096 China South China University of Technology Key Library of Autonomous Systems and Network Control Ministry of Education The School of Automation Science and Engineering Guangzhou510640 China Institute for Super Robotics Huangpu Guangzhou510555 China Nanchang University Jiangxi Thousand Talents Plan Nanchang330031 China Jishou University College of Computer Science and Engineering Jishou416000 China Guangdong Artificial Intelligence and Digital Economy Laboratory Pazhou Lab Guangzhou510335 China Shaanxi University of Technology Shaanxi Provincial Key Laboratory of Industrial Automation School of Mechanical Engineering Hanzhong723001 China Changsha Normal University School of Information Science and Engineering Changsha410100 China Guangdong University of Petrochemical Technology School of Automation Science and Engineering Institute of Artificial Intelligence and Automation Maoming525000 China

In the era of artificial intelligence generated content (AIGC), conditional multimodal synthesis technologies (e.g., text-to-image) are dynamically reshaping the natural content. Brain signals, serving as potential reflections of how the brain interprets external information, exhibit a distinctive one-to-many correspondence with various external modalities. This correspondence makes brain signals emerge as a promising guiding condition for multimodal synthesis (e.g., image, text, and audio), which is crucial for developing practical brain–computer interface systems and unraveling complex mechanisms underlying human perception. This survey comprehensively examines the emerging field of brain-conditional multimodal synthesis, termed AIGC-brain, to delineate the current landscape and future directions. To begin, related neuroimaging datasets and generative models are introduced as the foundation of AIGC-brain decoding and analysis. Next, we present a comprehensive taxonomy according to AIGC-brain methodologies, followed by task-specific representative work and implementation details to facilitate in-depth comparison and analysis. Quality assessments are then introduced for both qualitative and quantitative evaluation. Finally, this survey explores insights gained, outlining current challenges and prospects of AIGC-brain. As a pioneering survey, this article paves the way for future advances in AIGC-brain research. © 2020 IEEE.

关键词： Taxonomies

KT-Imitation: Efficient Visual Imitation for Autonomous Navigation Based on Keypoint Timeline

学校读者我要写书评

暂无评论

KT-Imitation: Efficient Visual Imitation for Autonomous Navi...

IEEE Latin American robotics Symposium, LARS

作者： Karen Li Hanqing Qi Jiawei Xu Edward Jeffs David Saldaña Department of Computer Science and Engineering Lehigh University Bethlehem PA USA Autonomous and Intelligent Robotics Laboratory (AIRLab) Lehigh University

ISBN: (数字)9798331508807

ISBN: (纸本)9798331508814

We introduce Keypoint Timeline (KT-) Imitation, a vision-only imitation algorithm for autonomous navigation. The algorithm is both data- and computation-efficient, as it only requires a single video demonstration. Different from methods in the literature, it does not require extensive action-observation information or an iterative learning process. The algorithm creates a timeline from a video demonstration to evaluate and fine-tune parameters for both the demonstrations and motion controls. This optimization improves the reliability and continuity of the ORB keypoints used in imitation tasks. We present an egocentric action-generation procedure that guides the imitator to carry the camera autonomously to follow the demonstration using the detected keypoints of the onboard camera. Our experiments validate the proposed approaches on a ground robot and an aerial vehicle against ground-truth recordings.

关键词： Visualization Navigation Robot vision systems Cameras Recording Reliability Iterative methods Motion control Optimization Autonomous robots

Bidirectional Human Interactive AI Framework for Social Robot Navigation

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Girgin, Tuba Girgin, Emre Yildirim, Yigit Ugur, Emre Haklidir, Mehmet Robotics and Autonomous Systems Laboratory TUBITAK BILGEM Kocaeli41470 Turkey Department of Computer Engineering Bogazici University Istanbul Turkey

Trustworthiness is a crucial concept in the context of human-robot interaction. Cooperative robots must be transparent regarding their decision-making process, especially when operating in a human-oriented environment. This paper presents a comprehensive end-to-end framework aimed at fostering trustworthy bidirectional human-robot interaction in collaborative environments for the social navigation of mobile robots. In this framework, the robot communicates verbally while the human guides with gestures. Our method enables a mobile robot to predict the trajectory of people and adjust its route in a socially-aware manner. In case of conflict between human and robot decisions, detected through visual examination, the route is dynamically modified based on human preference while verbal communication is maintained. We present our pipeline, framework design, and preliminary experiments that form the foundation of our proposition. © 2024, CC BY.

关键词： Mobile robots

Volumetric Mapping with Panoptic Refinement via Kernel Density Estimation for Mobile Robots

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Nguyen, Khang Dang, Tuan Huber, Manfred The Learning and Adaptive Robotics Laboratory Department of Computer Science and Engineering University of Texas at Arlington ArlingtonTX76013 United States

Reconstructing three-dimensional (3D) scenes with semantic understanding is vital in many robotic applications. Robots need to identify which objects, along with their positions and shapes, to manipulate them precisely with given tasks. Mobile robots, especially, usually use lightweight networks to segment objects on RGB images and then localize them via depth maps;however, they often encounter out-of-distribution scenarios where masks over-cover the objects. In this paper, we address the problem of panoptic segmentation quality in 3D scene reconstruction by refining segmentation errors using non-parametric statistical methods. To enhance mask precision, we map the predicted masks into a depth frame to estimate their distribution via kernel densities. The outliers in depth perception are then rejected without the need for additional parameters in an adaptive manner to out-of-distribution scenarios, followed by 3D reconstruction using projective signed distance functions (SDFs). We validate our method on a synthetic dataset, which shows improvements in both quantitative and qualitative results for panoptic mapping. Through real-world testing, the results furthermore show our method’s capability to be deployed on a real-robot system. Our source code is available at: https://***/mkhangg/refined panoptic mapping. Copyright © 2024, The Authors. All rights reserved.

关键词： Mobile robots

V3D-SLAM: Robust RGB-D SLAM in Dynamic Environments with 3D Semantic Geometry Voting

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Dang, Tuan Nguyen, Khang Huber, Manfred The Learning and Adaptive Robotics Laboratory Department of Computer Science and Engineering University of Texas at Arlington ArlingtonTX76013 United States

Simultaneous localization and mapping (SLAM) in highly dynamic environments is challenging due to the correlation complexity between moving objects and the camera pose. Many methods have been proposed to deal with this problem;however, the moving properties of dynamic objects with a moving camera remain unclear. Therefore, to improve SLAM’s performance, minimizing disruptive events of moving objects with a physical understanding of 3D shapes and dynamics of objects is needed. In this paper, we propose a robust method, V3D-SLAM, to remove moving objects via two lightweight reevaluation stages, including identifying potentially moving and static objects using a spatial-reasoned Hough voting mechanism and refining static objects by detecting dynamic noise caused by intra-object motions using Chamfer distances as similarity measurements. Our experiment on the TUM RGB-D benchmark on dynamic sequences with ground-truth camera trajectories showed that our methods outperform the most recent state-of-the-art SLAM methods. Our source code is available at https://***/tuantdang/v3d-slam. © 2024, CC BY.

关键词： Object detection

Real-Time 3D Semantic Scene Perception for Egocentric Robots with Binocular Vision

学校读者我要写书评

暂无评论

arXiv 2024年

Perceiving a three-dimensional (3D) scene with multiple objects while moving indoors is essential for vision-based mobile cobots, especially for enhancing their manipulation tasks. In this work, we present an end-to-end pipeline with instance segmentation, feature matching, and point-set registration for egocentric robots with binocular vision and demonstrate the robot’s grasping capability through the proposed pipeline. First, we design an RGB image-based segmentation approach for single-view 3D semantic scene segmentation, leveraging common object classes in 2D datasets to encapsulate 3D points into point clouds of object instances through corresponding depth maps. Next, 3D correspondences of two consecutive segmented point clouds are extracted based on matched keypoints between objects of interest in RGB images from the prior step. In addition, to be aware of spatial changes in 3D feature distribution, we also weigh each 3D point pair based on the estimated distribution using kernel density estimation (KDE), which subsequently gives robustness with less central correspondences while solving for rigid transformations between point clouds. Finally, we test our proposed pipeline on the 7-DOF dual-arm Baxter robot with a mounted Intel RealSense D435i RGB-D camera. The result shows that our robot can segment objects of interest, register multiple views while moving, and grasp the target object. The source code is available at https://***/mkhangg/semantic scene perception. Copyright © 2024, The Authors. All rights reserved.

关键词： Pipelines