检索结果-内蒙古大学图书馆

Sailing Through Point Clouds: Safe Navigation Using Point Cloud Based Control Barrier Functions

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Dai, Bolun Khorrambakht, Rooholla Krishnamurthy, Prashanth Khorrami, Farshad Control/Robotics Research Laboratory Electrical & Computer Engineering Department Tandon School of Engineering New York University BrooklynNY11201 United States

The capability to navigate safely in an unstructured environment is crucial when deploying robotic systems in real-world scenarios. Recently, control barrier function (CBF) based approaches have been highly effective in synthesizing safety-critical controllers. In this work, we propose a novel CBF-based local planner comprised of two components: Vessel and Mariner. The Vessel is a novel scaling factor based CBF formulation that synthesizes CBFs using only point cloud data. The Mariner is a CBF-based preview control framework that is used to mitigate getting stuck in spurious equilibria during navigation. To demonstrate the efficacy of our proposed approach, we first compare the proposed point cloud based CBF formulation with other point cloud based CBF formulations. Then, we demonstrate the performance of our proposed approach and its integration with global planners using experimental studies on the Unitree B1 and Unitree Go2 quadruped robots in various environments. © 2024, CC BY.

关键词： Robot programming

Combining Scene Coordinate Regression and Absolute Pose Regression for Visual Relocalization

学校读者我要写书评

暂无评论

Combining Scene Coordinate Regression and Absolute Pose Regr...

IEEE International Conference on robotics and Automation (ICRA)

作者： Jiahao Ruan Li He Yisheng Guan Hong Zhang School of Electromechanical Engineering Guangdong University of Technology Guangzhou China Department of Electrical and Electronic Engineering Shenzhen Key - Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China

Visual relocalization is a fundamental problem in computer vision and robotics. Recently, regression-based methods become popular and they can be categorized into two classes: absolute pose regression and scene coordinate regression. In this work, we present a combined regression network that jointly learns scene coordinate regression and absolute pose regression for single-image visual relocalization. The proposed network composes of a feature encoder and two regression branches with uncertainty modeling. In particular, we design a deep feature conditioning module, aiming at propagating the coarse pose information in absolute pose regression to inform the predictions in scene coordinate regression. The proposed network is trained in an end-to-end fashion to learn both regression tasks. Moreover, we propose an uncertainty-driven RANSAC algorithm that incorporates the predicted scene coordinates and their uncertainties to solve the camera pose during inference. To the best of our knowledge, this work is the first to combine scene coordinate regression and pose regression in a hierarchical framework for visual relocalization. Experiments on indoor and outdoor benchmarks demonstrate the effectiveness and the superiority of the proposed method over the state-of-the-art methods.

关键词：

Efficient Object Rearrangement via Multi-view Fusion

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Huang, Dehao Tang, Chao Zhang, Hong Shenzhen Key Laboratory of Robotics and Computer Vision Southern University of Science and Technology Shenzhen China Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China

The prospect of assistive robots aiding in object organization has always been compelling. In an image-goal setting, the robot rearranges the current scene to match the single image captured from the goal scene. The key to an image-goal rearrangement system is estimating the desired placement pose of each object based on the single goal image and observations from the current scene. In order to establish sufficient associations for accurate estimation, the system should observe an object from a viewpoint similar to that in the goal image. Existing image-goal rearrangement systems, due to their reliance on a fixed viewpoint for perception, often require redundant manipulations to randomly adjust an object’s pose for a better perspective. Addressing this inefficiency, we introduce a novel object rearrangement system that employs multi-view fusion. By observing the current scene from multiple viewpoints before manipulating objects, our approach can estimate a more accurate pose without redundant manipulation times. A standard visual localization pipeline at the object level is developed to capitalize on the advantages of multi-view observations. Simulation results demonstrate that the efficiency of our system outperforms existing single-view systems. The effectiveness of our system is further validated in a physical experiment. Copyright © 2023, The Authors. All rights reserved.

关键词：

Deep Learning-Based Prediction of Subsurface Oil Reservoir Pressure Using Spatio-Temporal Data 49

学校读者我要写书评

暂无评论

Deep Learning-Based Prediction of Subsurface Oil Reservoir P...

49th Annual Conference of the IEEE Industrial Electronics Society, IECON 2023

作者： Cheng, Haibo He, Yunpeng Zeng, Peng Li, Shichao Vyatkin, Valeriy Shenyang Institute of Automation Chinese Academy of Sciences State Key Laboratory of Robotics Shenyang China Chinese Academy of Sciences Key Laboratory of Networked Control Systems Shenyang China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of Sciences Shenyang China University of Chinese Academy of Sciences Beijing China Luleå University of Technology Department of Computer Science Electrical and Space Engineering Luleå Sweden Aalto University Department of Electrical Engineering and Automation Helsinki Finland

ISBN: (纸本)9798350331820

Prediction of subsurface oil reservoir pressure are critical to hydrocarbon production. However, the accurate pressure estimation faces great challenges due to the complexity and uncertainty of reservoir. The underground seepage flow and petrophysical parameters (permeability and porosity) are important but difficult to measure in oilfield. Deep learning methods have been successfully used in reservoir engineering and oil & gas production process. In this study, the effective but inaccessible subsurface seepage fields are not used, only the spatial coordinates and temporal information are selected as model input to predict reservoir pressure. A stacked GRU-based deep learning model is proposed to map the relationship between spatio-temporal data and reservoir pressure. The proposed deep learning method is verified by using a three-dimensional reservoir model, and compared with commonly-used methods. The results show that the stacked GRU model has a better performance and higher accuracy than other deep learning or machine learning methods in pressure prediction. © 2023 IEEE.

关键词： Forecasting

MSMB-GCN: Multi-scale Multi-branch Fusion Graph Convolutional Networks for 3D Human Pose Estimation

学校读者我要写书评

暂无评论

MSMB-GCN: Multi-scale Multi-branch Fusion Graph Convolutiona...

2023 IEEE International Conference on robotics and Biomimetics, ROBIO 2023

作者： Ji, Shanshan Meng, Qiwei Wang, Wen Lin, Zheyuan Li, Te Wan, Minhong Zhang, Chunlong Gu, Jason Research Institute of Interdisciplinary Innovation Zhejiang Laboratory Research Center for Intelligent Robotics Hangzhou311100 China Dalhousie University Department of Electrical and Computer Engineering HalifaxNSB3H 4R2 Canada

ISBN: (纸本)9798350325706

In human-robot interaction (HRI), human pose estimation is a necessary technology for the robot to perceive the dynamic environment and make interactive actions. Recently, graph convolutional networks (GCNs) have been increasingly used for 2D to 3D pose estimation tasks since the skeleton topologies can be viewed as graph structures. In this paper, we propose a novel graph convolutional network architecture, Multi-scale Multi-branch Fusion Graph Convolutional Networks (MSMB-GCN), for 3D Human Pose Estimation(3D HPE) task. The proposed model consists of multiple GCN blocks with a multi-branch architecture. This multi-branch architecture enables the model to get multi-scale features for human skeletal representations. The group of GCN blocks, which has strong multi-level feature extraction capabilities, allows the model to learn global and local features, lower-level and higher-level features. Experiment results on the HumanPose benchmark demonstrate that our model outperforms the state-of-the-art and ablation studies validate the effectiveness of our approach. © 2023 IEEE.

关键词：

Confidence-Aware Safe and Stable Control of Control-Affine Systems

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Wei, Shiqing Krishnamurthy, Prashanth Khorrami, Farshad Control/Robotics Research Laboratory Department of Electrical and Computer Engineering NYU Tandon School of Engineering 5 Metrotech Center BrooklynNY11201 United States

Designing control inputs that satisfy safety requirements is crucial in safety-critical nonlinear control, and this task becomes particularly challenging when full-state measurements are unavailable. In this work, we address the problem of synthesizing safe and stable control for control-affine systems via output feedback (using an observer) while reducing the estimation error of the observer. To achieve this, we adapt control Lyapunov function (CLF) and control barrier function (CBF) techniques to the output feedback setting. Building upon the existing CLF-CBF-QP (Quadratic Program) and CBF-QP frameworks, we formulate two confidence-aware optimization problems and establish the Lipschitz continuity of the obtained solutions. To validate our approach, we conduct simulation studies on two illustrative examples. The simulation studies indicate both improvements in the observer’s estimation accuracy and the fulfillment of safety and control requirements. © 2024, CC BY.

关键词： Lyapunov functions

Review of Inference Time Prediction Approaches of DNN: Emphasis on Service robots with cloud-edge-device architecture

学校读者我要写书评

暂无评论

Review of Inference Time Prediction Approaches of DNN: Empha...

2023 IEEE International Conference on robotics and Biomimetics, ROBIO 2023

作者： Xiang, Tian Meng, Qiwei Zhang, Ji Zhang, Beibei Song, Wei Xie, Anhuan Gu, Jason Research Institute of Interdisciplinary Innovation Zhejiang Laboratory Research Center for Intelligent Robotics Hangzhou311100 China The Chinese University of Hong Kong T Stone Robotics Institute Department of Mechanical and Automation Engineering Hong Kong Research Institute of Intelligent Computing Zhejiang Laboratory Research Center for Intelligent Computing Software Hangzhou311100 China Dalhousie University Electrical and Computer Engineering Halifax Canada

ISBN: (纸本)9798350325706

In recent years, the global robot market has witnessed substantial growth, particularly in the domain of service robots. Despite their expanding presence, service robots encounter limitations when operating autonomously in unstructured environments, primarily due to their constrained computational capacities. As a solution, the fusion of cloud and edge computing resources becomes imperative to expedite task inference and enhance scenario perception capabilities. The integration of cloud-edge-device models holds significant promise in bolstering the operational efficiency of robots. This entails the dynamic partitioning of intricate robotic tasks, executed collaboratively across cloud, edge, and device resources. In this landscape, deep neural network (DNN) models play a pivotal role in facilitating a wide array of robotic tasks. The inference time for each layer of a DNN model in actual deployment, emerges as a critical determinant in the model's partitioning strategy. It also serves as an important metric influencing the model's suitability for a specific hardware platform. This article presents an overview of recent advancements in predicting inference and training time of DNN models, summarizes the related methods, and finally discusses the challenges in this field and the research that can be studied in the future. © 2023 IEEE.

关键词：

Proactive Robot Control for Collaborative Manipulation Using Human Intent

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Rysbek, Zhanibek Li, Siyu Shervedani, Afagh Mehri Žefran, Miloš The Robotics Laboratory Department of Electrical and Computer Engineering The University of Illinois Chicago ChicagoIL60607 United States

Collaborative manipulation task often requires negotiation using explicit or implicit communication. An important example is determining where to move when the goal destination is not uniquely specified, and who should lead the motion. This work is motivated by the ability of humans to communicate the desired destination of motion through back- and-forth force exchanges. Inherent to these exchanges is also the ability to dynamically assign a role to each participant, either taking the initiative or deferring to the partner's lead. In this paper, we propose a hierarchical robot control framework that emulates human behavior in communicating a motion destination to a human collaborator and in responding to their actions. At the top level, the controller consists of a set of finite-state machines corresponding to different levels of commitment of the robot to its desired goal configuration. The control architecture is loosely based on the human strategy observed in the human-human experiments, and the key component is a real-time intent recognizer that helps the robot respond to human actions. We describe the details of the control framework, and feature engineering and training process of the intent recognition. The proposed controller was implemented on a UR10e robot (Universal Robots) and evaluated through human studies. The experiments show that the robot correctly recognizes and responds to human input, communicates its intent clearly, and resolves conflict. We report success rates and draw comparisons with human-human experiments to demonstrate the effectiveness of the approach. Copyright © 2023, The Authors. All rights reserved.

关键词： Controllers

Gait Optimization for Legged Systems Through Mixed Distribution Cross-Entropy Optimization

学校读者我要写书评

暂无评论

Gait Optimization for Legged Systems Through Mixed Distribut...

IEEE-RAS International Conference on Humanoid Robots

作者： Ioannis Tsikelis Konstantinos Chatzilygeroudis Computer Engineering and Informatics Department University of Patras Patras Greece Department of Electrical & Computer Engineering Laboratory of Automation and Robotics (LAR) University of Patras Patras Greece Department of Mathematics Computational Intelligence Laboratory (CILab) University of Patras Patras Greece

ISBN: (数字)9798350373578

ISBN: (纸本)9798350373585

Legged robotic systems can play an important role in real-world applications due to their superior load-bearing capabilities, enhanced autonomy, and effective navigation on uneven terrain. They offer an optimal trade-off between mobility and payload capacity, excelling in diverse environments while maintaining efficiency in transporting heavy loads. However, planning and optimizing gaits and gait sequences for these robots presents significant challenges due to the complexity of their dynamic motion and the numerous optimization variables involved. Traditional trajectory optimization methods address these challenges by formulating the problem as an optimization task, aiming to minimize cost functions, and to automatically discover contact sequences. Despite their structured approach, optimization-based methods face substantial difficulties, particularly because such formulations result in highly nonlinear and difficult to solve problems. To address these limitations, we propose CrEGOpt, a bi-level optimization method that combines traditional trajectory optimization with a black-box optimization scheme. CrEGOpt at the higher level employs the Mixed Distribution Cross-Entropy Method to optimize both the gait sequence and the phase durations, thus simplifying the lower level trajectory optimization problem. This approach allows for fast solutions of complex gait optimization problems. Extensive evaluation in simulated environments demonstrates that CrEGOpt can find solutions for biped, quadruped, and hexapod robots in under 10 seconds. This novel bi-level optimization scheme offers a promising direction for future research in automatic contact scheduling.

关键词： Pipelines Closed box Humanoid robots Graphics processing units Real-time systems Planning Quadrupedal robots Optimization Trajectory optimization Convergence