检索结果-内蒙古大学图书馆

Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimation

IEEE Transactions on Pattern Analysis and Machine Intelligence 2025年第7期47卷 5520-5537页

作者： Jian Liu Wei Sun Hui Yang Pengchao Deng Chongpei Liu Nicu Sebe Hossein Rahmani Ajmal Mian National Engineering Research Center for Robot Visual Perception and Control Technology College of Electrical and Information Engineering School of Robotics and the State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body Hunan University Changsha China Institute of Artificial Intelligence and Robotics Xi’an Jiaotong University Xi’an China Department of Information Engineering and Computer Science University of Trento Trento Italy School of Computing and Communications Lancaster University Lancaster U.K. Department of Computer Science The University of Western Australia Crawley WA Australia

Nine-degrees-of-freedom (9-DoF) object pose and size estimation is crucial for enabling augmented reality and robotic manipulation. Category-level methods have received extensive research attention due to their potential for generalization to intra-class unknown objects. However, these methods require manual collection and labeling of large-scale real-world training data. To address this problem, we introduce a diffusion-based paradigm for domain-generalized category-level 9-DoF object pose estimation. Our motivation is to leverage the latent generalization ability of the diffusion model to address the domain generalization challenge in object pose estimation. This entails training the model exclusively on rendered synthetic data to achieve generalization to real-world scenes. We propose an effective diffusion model to redefine 9-DoF object pose estimation from a generative perspective. Our model does not require any 3D shape priors during training or inference. By employing the Denoising Diffusion Implicit Model, we demonstrate that the reverse diffusion process can be executed in as few as 3 steps, achieving near real-time performance. Finally, we design a robotic grasping system comprising both hardware and software components. Through comprehensive experiments on two benchmark datasets and the real-world robotic system, we show that our method achieves state-of-the-art domain generalization performance.

关键词： Shape Solid modeling Three-dimensional displays Pose estimation Training Robots Grasping Diffusion models Real-time systems Point cloud compression

来源：评论

学校读者我要写书评

暂无评论

Uncertainty Quantification for Recursive Estimation in Adaptive Safety-Critical Control

Uncertainty Quantification for Recursive Estimation in Adapt...

引用

American Control Conference (ACC)

作者： Max H. Cohen Makai Mann Kevin Leahy Calin Belta Department of Mechanical and Civil Engineering California Institute of Technology Pasadena CA Massachusetts Institute of Technology Lincoln Laboratory Lexington MA Department of Robotics Engineering Worcester Polytechnic Institute Worcester MA Department of Electrical and Computer Engineering University of Maryland College Park MD

ISBN: (数字)9798350382655

ISBN: (纸本)9798350382662

In this paper, we present a framework for online parameter estimation and uncertainty quantification in the context of adaptive safety-critical control. The key insight enabling our approach is that the parameter estimate generated by the continuous-time recursive least squares (RLS) algorithm at any point in time is an affine transformation of the initial parameter estimate. This property allows for parameterizing such estimates using objects that are closed under affine transformation, such as zonotopes, and enables the efficient propagation of such set-based estimates as time progresses. We illustrate how such an approach facilitates the synthesis of safety-critical controllers for systems with parametric uncertainty and additive disturbances using control barrier functions, and demonstrate the utility of our approach through illustrative examples.

关键词： Uncertainty Parameter estimation Additives Control systems Recursive estimation

来源：评论

学校读者我要写书评

暂无评论

A Joint Tracking System: Robot is Online to Access Surveillance Views

A Joint Tracking System: Robot is Online to Access Surveilla...

引用

IEEE International Conference on robotics and Biomimetics

作者： Zheyuan Lin Shanshan Ji Wen Wang Mengjie Qin Rong Yang Minhong Wan Jason Gu Te Li Chunlong Zhang Research Center for Intelligent Robotics Zhejiang Laboratory Research Institute of Interdisciplinary Innovation Hangzhou China Zhejiang Engineering Research Center for Intelligent Robotics Hangzhou China Department of Electrical and Computer Engineering Dalhousie University Halifax Canada

The application of robots in social life, equipped with sensors and actuators and embedded with AI, assists people in all aspects. However, the first perspective of the robot horizon is heavily constrained, which weakens its performance. A joint tracking system is designed and built to deal with this, by integrating a surveillance system with the robot visual, providing a third perspective. This system takes one horizontal view and two top views from various directions as inputs and matches a person among the frames and in time sequence. In order to deal with the identity match with a huge visual feature gap, a special dataset is collected, simultaneously labeling identities from a mobile robot perspective and multiple indoor static surveillance monitors. The experiment shows that such match is a task worth exploring that can be better handled by training on our dataset than existing open source Re-identification (Re-id) datasets. Moreover, in the real scenario, this system improves the performance on issues like in and out of the robot’s field of vision and heavy occlusion by people or objects.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Real-Time Imitation of Human Head Motions, Blinks and Emotions by Nao Robot: A Closed-Loop Approach

Real-Time Imitation of Human Head Motions, Blinks and Emotio...

引用

RSI/ISM International Conference on robotics and Mechatronics (ICROM)

作者： Keyhan Rayati Amirhossein Feizi Alireza Beigy Pourya Shahverdi Mehdi Tale Masouleh Ahmad Kalhor Wing-Yue Geoffrey Louie Human and Robot Interaction Lab Electrical and Computer Engineering University of Tehran Tehran Iran Department of Electrical Engineering Shahrood University of Technology Shahrood Iran Intelligent Robotics Laboratory Oakland University Michigan USA

This paper introduces a novel approach for enabling real-time imitation of human head motion by a Nao robot, with a primary focus on elevating human-robot interactions. By using the robust capabilities of the MediaPipe as a computer vision library and the DeepFace as an emotion recognition library, this research endeavors to capture the subtleties of human head motion, including blink actions and emotional expressions, and seamlessly incorporate these indicators into the robot’s responses. The result is a comprehensive framework which facilitates precise head imitation within human-robot interactions, utilizing a closed-loop approach that involves gathering real-time feedback from the robot’s imitation performance. This feedback loop ensures a high degree of accuracy in modeling head motion, as evidenced by an impressive R2 score of 96.3 for pitch and 98.9 for yaw. Notably, the proposed approach holds promise in improving communication for children with autism, offering them a valuable tool for more effective interaction. In essence, proposed work explores the integration of real-time head imitation and real-time emotion recognition to enhance human-robot interactions, with potential benefits for individuals with unique communication needs.

关键词：

来源：评论

学校读者我要写书评

暂无评论

PROSPECT: Precision Robot Spectroscopy Exploration and Characterization Tool

arXiv

引用

arXiv 2024年

作者： Hanson, Nathaniel Lvov, Gary Rautela, Vedant Hibbard, Samuel Holand, Ethan DiMarzio, Charles Padır, Taşkın Institute for Experiential Robotics Electrical and Computer Engineering Department Northeastern University BostonMA United States Robotics Institute Carnegie Mellon University PittsburghPA United States Lincoln Laboratory Massachusetts Institute of Technology LexingtonMA United States

Near Infrared (NIR) spectroscopy is widely used in industrial quality control and automation to test the purity and grade of items. In this research, we propose a novel sensorized end effector and acquisition strategy to capture spectral signatures from objects and register them with a 3D point cloud. Our methodology first takes a 3D scan of an object generated by a time-of-flight depth camera and decomposes the object into a series of planned viewpoints covering the surface. We generate motion plans for a robot manipulator and end-effector to visit these viewpoints while maintaining a fixed distance and surface normal. This process is enabled by the spherical motion of the end-effector and ensures maximal spectral signal quality. By continuously acquiring surface reflectance values as the end-effector scans the target object, the autonomous system develops a four-dimensional model of the target object: position in an R3 coordinate frame, and a reflectance vector denoting the associated spectral signature. We demonstrate this system in building spectral-spatial object profiles of increasingly complex geometries. We show the proposed system and spectral acquisition planning produce more consistent spectral signals than naïve point scanning strategies. Our work represents a significant step towards high-resolution spectral-spatial sensor fusion for automated quality assessment. © 2024, CC BY-NC-SA.

关键词： Infrared devices

来源：评论

学校读者我要写书评

暂无评论

MINER-RRT*: A Hierarchical and Fast Trajectory Planning Framework in 3D Cluttered Environments

arXiv

引用

arXiv 2024年

作者： Wang, Pengyu Tang, Jiawei Lin, Hin Wang Zhang, Fan Wang, Chaoqun Wang, Jiankun Shi, Ling Meng, Max Q.-H. Shenzhen Key Laboratory of Robotics Perception and Intelligence The Department of Electronic and Electrical Engineering Southern University of Science and Technology Shenzhen China The Department of Electronic and Computer Engineering Hong Kong University of Science and Technology Hong Kong The Department of Electronic Engineering The Chinese University of Hong Kong Hong Kong The Department of Electrical and Computer Engineering The University of Alberta Canada The School of Control Science and Engineering Shandong University Shandong China

—Trajectory planning for quadrotors in cluttered environments has been challenging in recent years. While many trajectory planning frameworks have been successful, there still exists potential for improvements, particularly in enhancing the speed of generating efficient trajectories. In this paper, we present a novel hierarchical trajectory planning framework to reduce computational time and memory usage called MINER-RRT*, which consists of two main components. First, we propose a sampling-based path planning method boosted by neural networks, where the predicted heuristic region accelerates the convergence of rapidly-exploring random trees. Second, we utilize the optimal conditions derived from the quadrotor’s differential flatness properties to construct polynomial trajectories that minimize control effort in multiple stages. Extensive simulation and real-world experimental results demonstrate that, compared to several state-of-the-art (SOTA) approaches, our method can generate high-quality trajectories with better performance in 3D cluttered environments. (Video1) Note to Practitioners—The motivation is the problem of planning trajectories for quadrotor autonomous flight in 3D cluttered and complex scenarios such as wild forest exploration and subterranean environment search-and-rescue. Sampling-based path planning methods are suitable for dealing with the complexity of the physical environment but are not convenient for computing dynamics and their differentials. Optimization-based trajectory generation methods are appropriate for handling various high-order constraints but rely on high-quality initial path solutions. Therefore, this paper combines the advantages of the two methods to propose a novel trajectory planning framework that can generate high-quality trajectories for quadrotors faster than many previous algorithms. We conduct numerous simulations and real-world experiments to verify that our method can be effectively deployed in real scenarios and empo

关键词： Deep neural networks

来源：评论

学校读者我要写书评

暂无评论

Realtime Particulate Matter and Bacteria Analysis of Peritoneal Dialysis Fluid using Digital Inline Holography

arXiv

引用

arXiv 2024年

作者： Bravo-Frank, Nicholas Mesyngier, Nicolas Feng, Lei Hong, Jiarong Department of Electrical and Computer Engineering University of Minnesota United States Saint Anthony Falls Laboratory University of Minnesota United States Minnesota Robotics Institute University of Minnesota United States Department of Mechanical Engineering University of Minnesota United States

We developed a digital inline holography (DIH) system integrated with deep learning algorithms for real-time detection of particulate matter (PM) and bacterial contamination in peritoneal dialysis (PD) fluids. The system comprises a microfluidic sample delivery module and a DIH imaging module that captures holograms using a pulsed laser and a digital camera with a 40× objective. Our data processing pipeline enhances holograms, reconstructs images, and employs a YOLOv8nbased deep learning model for particle identification and classification, trained on labeled holograms of generic PD particles, Escherichia coli (E. coli), and Pseudomonas aeruginosa (P. aeruginosa). The system effectively detected and classified generic particles in sterile PD fluids, revealing diverse morphologies predominantly sized 1–5 µm with an average concentration of 61 particles/µL. In PD fluid samples spiked with high concentrations of E. coli and P. aeruginosa, our system achieved high sensitivity (>90%) in detecting and classifying these bacteria at clinically relevant low false positive rates (~0.5%). Further validation against standard colony-forming unit (CFU) methods using PD fluid spiked with bacterial concentrations from approximately 100 to 10,000 bacteria/mL demonstrated a clear one-to-one correspondence between our measurements and CFU counts. Our DIH system provides a rapid, accurate alternative to traditional culture-based methods for assessing bacterial contamination in PD fluids. By enabling real-time sterility monitoring, it can significantly improve patient outcomes in PD treatment, facilitate point-of-care fluid production, reduce logistical challenges, and be extended to quality control in pharmaceutical production. © 2024, CC BY.

关键词： Escherichia coli

来源：评论

学校读者我要写书评

暂无评论

Hinge-Wasserstein: Estimating Multimodal Aleatoric Uncertainty in Regression Tasks

arXiv

引用

arXiv 2023年

作者： Xiong, Ziliang Jonnarth, Arvi Eldesokey, Abdelrahman Johnander, Joakim Wandt, Bastian Forssén, Per-Erik Computer Vision Laboratory Department of Electrical Engineering LiU Sweden Visual Computing Center KAUST Saudi Arabia Husqvarna Group Huskvarna Sweden Zenseact Sweden

computer vision systems that are deployed in safety-critical applications need to quantify their output uncertainty. We study regression from images to parameter values and here it is common to detect uncertainty by predicting probability distributions. In this context, we investigate the regression-by-classification paradigm which can represent multimodal distributions, without a prior assumption on the number of modes. Through experiments on a specifically designed synthetic dataset, we demonstrate that traditional loss functions lead to poor probability distribution estimates and severe overconfidence, in the absence of full ground truth distributions. In order to alleviate these issues, we propose hinge-Wasserstein – a simple improvement of the Wasserstein loss that reduces the penalty for weak secondary modes during training. This enables prediction of complex distributions with multiple modes, and allows training on datasets where full ground truth distributions are not available. In extensive experiments, we show that the proposed loss leads to substantially better uncertainty estimation on two challenging computer vision tasks: horizon line detection and stereo disparity estimation. The code is available at:https://***/XZLeo/ hinge-Wasserstein Copyright © 2023, The Authors. All rights reserved.

关键词： Probability distributions

来源：评论

学校读者我要写书评

暂无评论

A Stable Lithium-ion Battery SOH Estimation Framework for Suppressing Measurement Noise with Unknown Distribution

引用

IEEE Transactions on Transportation Electrification 2025年

作者： Ma, Wentao Xue, Jingsong Li, Yang Guo, Peng Liu, Xinghua Wei, Zhongbao Wang, Yiwen Chen, Badong Xi’an University of Technology School of Electrical Engineering 710048 China Chalmers University of Technology Department of Electrical Engineering Gothenburg41296 Sweden Beijing Institute of Technology National Engineering Laboratory for Electric Vehicles School of Mechanical Engineering Beijing100081 China Hong Kong University of Science and Technology Department of Electronic and Computer Engineering Hong Kong Institute of artificial intelligence and robotics Xi’an Jiaotong University Xi’an710048 China

Existing methods for estimating the state of health (SOH) of lithium-ion battery (LIB) typically rely on the assumption that the distribution of noise (or outliers) in the measurement data is known. However, this assumption rarely holds true for LIB operating under real-word conditions. This article proposes a stable framework for accurate SOH estimation that accommodates noises with unknown distribution in both measurement data and label values. The framework combines generalized correntropy loss (GCL) with Savitzky-Golay (SG) filter and extreme learning machine (ELM) to obtain measurement data filter named SG-GCL and SOH estimator named generalized ELM (GELM), respectively. The SG-GCL filtering of the measurement data keeps the root mean square error (RMSE) within 0.0365%, and Pearson correlation between extracted feature and SOH improves by 0.4963, which in turn leads to the reduction of the RMSE metrics of the ELM for the estimation of the SOH by 43.69%. From the filtering results, feature extraction and estimation results proved its necessity and effectiveness. GELM effectively suppresses the influence of label value noise on the model in the training process, which reduces the SOH estimation RMSE index by more than 0.66%. The results from experiments with different distributional noise conditions show that the proposed SOH estimation framework has excellent and stable performance. © 2015 IEEE.

关键词： Mean square error

来源：评论

学校读者我要写书评

暂无评论

A tethered quadrotor UAV-buoy system for marine locomotion

arXiv

引用

arXiv 2021年

作者： Kourani, Ahmad Daher, Naseem Vision and Robotics Lab Department of Mechanical Engineering American University of Beirut Beirut Lebanon Vision and Robotics Lab Department of Electrical and Computer Engineering

Unmanned aerial vehicles (UAVs) are finding their way into offshore applications. In this work, we postulate an original system that entails a marine locomotive quadrotor UAV that manipulates the velocity of a floating buoy by means of a cable. By leveraging the advantages of UAVs relative to high speed, maneuverability, ease of deployment, and wide field of vision, the proposed UAV-buoy system paves the way in front of a variety of novel applications. The dynamic model that couples the buoy, UAV, cable, and water environment is presented using the Euler-Lagrange method. A stable control system design is proposed to manipulate the forward-surge speed of the buoy under two constraints: maintaining the cable in a taut state, and keeping the buoy in contact with the water surface. Polar coordinates are used in the controller design process to attain correlated effects on the tracking performance, whereby each control channel independently affects one control parameter. This results in improved performance over traditional Cartesian-based velocity controllers, as demonstrated via numerical simulations in wave-free and wavy seas. Copyright © 2021, The Authors. All rights reserved.

关键词： Unmanned aerial vehicles (UAV)

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：