检索结果-内蒙古大学图书馆

arXiv 2025年

作者： Liu, Jian Sun, Wei Yang, Hui Deng, Pengchao Liu, Chongpei Sebe, Nicu Rahmani, Hossein Mian, Ajmal National Engineering Research Center for Robot Visual Perception and Control Technology College of Electrical and Information Engineering School of Robotics State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body Hunan University Changsha410082 China Institute of Artificial Intelligence and Robotics Xi’an Jiaotong University Xi’an710049 China Department of Information Engineering and Computer Science University of Trento Trento38123 Italy School of Computing and Communications Lancaster University LA1 4YW United Kingdom Department of Computer Science The University of Western Australia WA6009 Australia

Nine-degrees-of-freedom (9-DoF) object pose and size estimation is crucial for enabling augmented reality and robotic manipulation. Category-level methods have received extensive research attention due to their potential for generalization to intra-class unknown objects. However, these methods require manual collection and labeling of large-scale real-world training data. To address this problem, we introduce a diffusion-based paradigm for domain-generalized category-level 9-DoF object pose estimation. Our motivation is to leverage the latent generalization ability of the diffusion model to address the domain generalization challenge in object pose estimation. This entails training the model exclusively on rendered synthetic data to achieve generalization to real-world scenes. We propose an effective diffusion model to redefine 9-DoF object pose estimation from a generative perspective. Our model does not require any 3D shape priors during training or inference. By employing the Denoising Diffusion Implicit Model, we demonstrate that the reverse diffusion process can be executed in as few as 3 steps, achieving near real-time performance. Finally, we design a robotic grasping system comprising both hardware and software components. Through comprehensive experiments on two benchmark datasets and the real-world robotic system, we show that our method achieves state-of-the-art domain generalization performance. Our code will be made public at https://***/CNJianLiu/Diff9D. Copyright © 2025, The Authors. All rights reserved.

关键词： Augmented reality

来源：评论

学校读者我要写书评

暂无评论

3D Scene Flow Estimation on Pseudo-LiDAR: Bridging the Gap on Estimating Point Motion

arXiv

引用

arXiv 2022年

作者： Jiang, Chaokang Wang, Guangming Miao, Yanzi Wang, Hesheng Engineering Research Center of Intelligent Control for Underground Space Ministry of Education School of Information and Control Engineering Advanced Robotics Research Center China University of Mining and Technology Xuzhou221116 China Department of Automation Key Laboratory of System Control and Information Processing Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Engineering Research Center of Intelligent Control and Management Shanghai Jiao Tong University Shanghai200240 China

3D scene flow characterizes how the points at the current time flow to the next time in the 3D Euclidean space, which possesses the capacity to infer autonomously the non-rigid motion of all objects in the scene. The previous methods for estimating scene flow from images have limitations, which split the holistic nature of 3D scene flow by estimating optical flow and disparity separately. Learning 3D scene flow from point clouds also faces the difficulties of the gap between synthesized and real data and the sparsity of LiDAR point clouds. In this paper, the generated dense depth map is utilized to obtain explicit 3D coordinates, which achieves direct learning of 3D scene flow from 2D images. The stability of the predicted scene flow is improved by introducing the dense nature of 2D pixels into the 3D space. Outliers in the generated 3D point cloud are removed by statistical methods to weaken the impact of noisy points on the 3D scene flow estimation task. Disparity consistency loss is proposed to achieve more effective unsupervised learning of 3D scene flow. The proposed method of self-supervised learning of 3D scene flow on real-world images is compared with a variety of methods for learning on the synthesized dataset and learning on LiDAR point clouds. The comparisons of multiple scene flow metrics are shown to demonstrate the effectiveness and superiority of introducing pseudo-LiDAR point cloud to scene flow estimation. © 2022, CC BY.

关键词： Three dimensional computer graphics

来源：评论

学校读者我要写书评

暂无评论

Unsupervised Learning of 3D Scene Flow with 3D Odometry Assistance

arXiv

引用

arXiv 2022年

作者： Wang, Guangming Feng, Zhiheng Jiang, Chaokang Wang, Hesheng Department of Automation Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Engineering Research Center of Intelligent Control and Management Shanghai Jiao Tong University Shanghai200240 China Engineering Research Center of Intelligent Control for Underground Space Ministry of Education School of Information and Control Engineering Advanced Robotics Research Center China University of Mining and Technology Xuzhou221116 China

Scene flow represents the 3D motion of each point in the scene, which explicitly describes the distance and the direction of each point’s movement. Scene flow estimation is used in various applications such as autonomous driving fields, activity recognition, and virtual reality fields. As it is challenging to annotate scene flow with ground truth for real-world data, this leaves no real-world dataset available to provide a large amount of data with ground truth for scene flow estimation. Therefore, many works use synthesized data to pre-train their network and real-world LiDAR data to finetune. Unlike the previous unsupervised learning of scene flow in point clouds, we propose to use odometry information to assist the unsupervised learning of scene flow and use real-world LiDAR data to train our network. Supervised odometry provides more accurate shared cost volume for scene flow. In addition, the proposed network has mask-weighted warp layers to get a more accurate predicted point cloud. The warp operation means applying an estimated pose transformation or scene flow to a source point cloud to obtain a predicted point cloud and is the key to refining scene flow from coarse to fine. When performing warp operations, the points in different states use different weights for the pose transformation and scene flow transformation. We classify the states of points as static, dynamic, and occluded, where the static masks are used to divide static and dynamic points, and the occlusion masks are used to divide occluded points. The mask-weighted warp layer indicates that static masks and occlusion masks are used as weights when performing warp operations. Our designs are proved to be effective in ablation experiments. The experiment results show the promising prospect of an odometry-assisted unsupervised learning method for 3D scene flow in real-world data. Copyright © 2022, The Authors. All rights reserved.

关键词： Deep learning

来源：评论

学校读者我要写书评

暂无评论

MA-FSAR: Multimodal Adaptation of CLIP for Few-Shot Action Recognition

arXiv

引用

arXiv 2023年

作者： Xing, Jiazheng Xu, Chao Wang, Mengmeng Dai, Guang Sun, Baigui Liu, Yong Wang, Jingdong Zhao, Jian Laboratory of Advanced Perception on Robotics and Intelligent Learning College of Control Science and Engineering Zhejiang University Zhejiang Hangzhou310027 China Alibaba Group China College of Computer Science and Technology Zhejiang University of Technology China SGIT AI Lab State Grid Corporation of China China Baidu China China Northwestern Polytechnical University Shanxi Xi’an China

Applying large-scale vision-language pre-trained models like CLIP to few-shot action recognition (FSAR) can significantly enhance both performance and efficiency. While several studies have recognized this advantage, most of them resort to full-parameter fine-tuning to make CLIP’s visual encoder adapt to the FSAR data, which not only costs high computations but also overlooks the potential of the visual encoder to engage in temporal modeling and focus on targeted semantics directly. To tackle these issues, we introduce MA-FSAR, a framework that employs the Parameter-Efficient Fine-Tuning (PEFT) technique to enhance the CLIP visual encoder in terms of action-related temporal and semantic representations. Our solution involves a Fine-grained Multimodal Adaptation, which is different from the previous attempts of PEFT in regular action recognition. Specifically, we first insert a Global Temporal Adaptation that only receives the class token to capture global motion cues efficiently. Then these outputs integrate with visual tokens to enhance local temporal dynamics by a Local Multimodal Adaptation, which incorporates text features unique to the FSAR support set branch to highlight fine-grained semantics related to actions. In addition to these token-level designs, we propose a prototype-level text-guided construction module to further enrich the temporal and semantic characteristics of video prototypes. Extensive experiments demonstrate our superior performance in various tasks using minor trainable parameters. © 2023, CC BY-SA.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

A Space Crawling Robotic Bio-Paw (Scrbp) Enabled by Triboelectric Sensors for Surface Identification

SSRN

引用

SSRN 2022年

作者： Hou, Xuyan Zhang, Li Gao, Guowei Liu, Yuhui Na, Zhonglai Xu, QingZhang Ding, Tianxiang Li, Long Chen, Tao Research Center of Aerospace Mechanism and Control School of Mechatronics Engineering Harbin Institute of Technology Harbin150080 China Department of MECHANICAL ENGINEERING FACULTY OF ENGINEERING Hong Kong Polytechnic University Hong Kong Shanghai Key Laboratory of Intelligent Manufacturing and Robotics School of Mechatronic Engineering and Automation Shanghai University Shanghai200444 China Jiangsu Provincial Key Laboratory of Advanced Robotics School of Mechanical and Electric Engineering Soochow University Suzhou215123 China

With the rapid development of space crawling robotics technology, tactile perception, a significant source for the robot to sense the external environment, has become the preferred solution to gather information in space. Sensors embedded in the robotic end-effector unit can collect and encode the large tactile data, allowing the robot to feel and perceive the real surroundings. Therefore, a space crawling robotic bio-paw (SCRBP) inspired by a cat paw, which performs as a compliant device and can flat the impulse force during the robot’s contact process to the target surface, is proposed in this paper. Meanwhile, a touch-sensing system embedded on SCRBP with self-powered sensors based on the triboelectric nanogenerator (TENG) technology is proposed which can provide the multi-dimensional sensation information in real time. By combining with machine learning (ML), the sensory system can be used for surface identification from the footfall process to the robot’s controller hub. In conclusion, SCRBP device proposed in this paper has obvious advantages in surface information acquisition, space adaptability, power consumption, cost, reliable signal and minimized data. Accordingly, SCRBP system shows fabulous potential in space robotics. © 2022, The Authors. All rights reserved.

关键词： End effectors

来源：评论

学校读者我要写书评

暂无评论

FFPA-Net: Efficient Feature Fusion with Projection Awareness for 3D Object Detection

arXiv

引用

arXiv 2022年

作者： Jiang, Chaokang Wang, Guangming Wu, Jinxing Miao, Yanzi Wang, Hesheng Engineering Research Center of Intelligent Control for Underground Space Ministry of Education School of Information and Control Engineering Advanced Robotics Research Center China University of Mining and Technology Xuzhou221116 China Department of Automation Key Laboratory of System Control and Information Processing of Ministry of Education Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education Shanghai Engineering Research Center of Intelligent Control and Management Shanghai Jiao Tong University Shanghai200240 China The Department of Engineering Mechanics Shanghai Jiao Tong University Shanghai200240 China

Promising complementarity exists between the texture features of color images and the geometric information of LiDAR point clouds. However, there still present many challenges for efficient and robust feature fusion in the field of 3D object detection. In this paper, first, unstructured 3D point clouds are filled in the 2D plane and 3D point cloud features are extracted faster using projection-aware convolution layers. Further, the corresponding indexes between different sensor signals are established in advance in the data preprocessing, which enables faster cross-modal feature fusion. To address LiDAR points and image pixels misalignment problems, two new plug- and-play fusion modules, LiCamFuse and BiLiCamFuse, are proposed. In LiCamFuse, soft query weights with perceiving the Euclidean distance of bimodal features are proposed. In BiLiCamFuse, the fusion module with dual attention is proposed to deeply correlate the geometric and textural features of the scene. The quantitative results on the KITTI dataset demonstrate that the proposed method achieves better feature-level fusion. In addition, the proposed network shows a shorter running time compared to existing methods. Copyright © 2022, The Authors. All rights reserved.

关键词： Object detection

来源：评论

学校读者我要写书评

暂无评论

An Improved Chimp Optimization Algorithm for Short-term Hydrothermal Scheduling

IAENG International Journal of Computer Science

引用

IAENG International Journal of Computer Science 2022年第3期49卷 666页

作者： Chen, Gonggui Wang, Shumin He, Yongsheng Shang, Wanfeng Long, Hongyu Key Laboratory of Industrial Internet of Things and Networked Control Ministry of Education Chongqing University of Posts and Telecommunications Chongqing400065 China Chongqing University of Posts and Telecommunications Chongqing400065 China State Grid Chongqing Electric Power Company Chongqing400015 China Guangdong Provincial Key Lab of Robotics and Intelligent System Shenzhen Institute of Advanced Technology Chinese Academy of Sciences Shenzhen Shenzhen518055 China Chongqing Key Laboratory of Complex Systems and Bionic Control Chongqing University of Posts and Telecommunications Chongqing400065 China

The short-term hydrothermal scheduling (STHS) is a complex non-linear, non-convex and high-dimensional mathematical optimization problem. Due to the fact that the original chimp optimization algorithm (ChOA) is likely to fall into local optimum and has the disadvantage of low population diversity, an improved chimp optimization algorithm (IChOA) is proposed to solve the STHS problem. Firstly, Logistic-Tent chaotic mapping is employed to initialize the population and increase the population diversity. Then a new nonlinear convergence factor is introduced to make the optimization search process more applicable to STHS problems. Next, particle swarm algorithm (PSO) and gravitational search algorithm (GSA) are combined to enhance the shortcoming and balance the global search ability and local exploration ability of ChOA. Moreover, Cauchy mutation and opposition-based learning strategy are supplemented as perturbation interference when the optimal position is not updated to improve the ability to leap out of the local optimum. Finally, a graded optimization strategy is adopted for the constraint handing of dynamic reservoir balance and thermal power balance. Three standard hydrothermal power systems are utilized to verify the practicability and validity of the proposed method. Results of simulations reveal that IChOA has significant competitive advantages in addressing the STHS problem. © 2022, IAENG International Journal of Computer Science. All Rights Reserved.

关键词： Particle swarm optimization (PSO)

来源：评论

学校读者我要写书评

暂无评论

Simultaneously Calibration of Multi Hand-Eye Robot System Based on Graph

arXiv

引用

arXiv 2023年

作者： Zhou, Zishun Ma, Liping Liu, Xilong Cao, Zhiqiang Yu, Junzhi The Institute of Automation Chinese Academy of Sciences Beijing100190 China The College of Electrical Engineering and Computer Science Australian National University Canberra2601 Australia The State Key Laboratory of Management and Control for Complex Systems Institute of Automation Chinese Academy of Sciences Beijing100190 China The School of Artificial Intelligence University of Chinese Academy of Sciences Beijing100049 China The State Key Laboratory for Turbulence and Complex System Department of Advanced Manufacturing and Robotics BIC-ESAT College of Engineering Peking University Beijing100871 China

Precise calibration is the basis for the vision-guided robot system to achieve high-precision operations. Systems with multiple eyes (cameras) and multiple hands (robots) are particularly sensitive to calibration errors, such as micro-assembly systems. Most existing methods focus on the calibration of a single unit of the whole system, such as poses between hand and eye, or between two hands. These methods can be used to determine the relative pose between each unit, but the serialized incremental calibration strategy cannot avoid the problem of error accumulation in a large-scale system. Instead of focusing on a single unit, this paper models the multi-eye and multi-hand system calibration problem as a graph and proposes a method based on the minimum spanning tree and graph optimization. This method can automatically plan the serialized optimal calibration strategy in accordance with the system settings to get coarse calibration results initially. Then, with these initial values, the closed-loop constraints are introduced to carry out global optimization. Simulation experiments demonstrate the performance of the proposed algorithm under different noises and various hand-eye configurations. In addition, experiments on real robot systems are presented to further verify the proposed method. © 2023, CC BY-SA.

关键词： Multipurpose robots

来源：评论

学校读者我要写书评

暂无评论

A Dynamic Adaptive Search Algorithm for CoSpace Rescue Robot 6

A Dynamic Adaptive Search Algorithm for CoSpace Rescue Robot

引用

6th International Conference on robotics and Automation Engineering, ICRAE 2021

作者： Chengbo, Li Xiaoming, Wang Zixi, Huang Guangyao, Pang Xinyu, Han Yaguang, Lin Dalian Free Trade Zone No. 1 High School Dalian China Key Laboratory of Modern Teaching Technology Ministry of Education Xi'an China School of Computer Science Shaanxi Normal University Xi'an710119 China Shenzhen Middle School Shenzhen China Wuzhou University School of Data Science and Software Engineering Wuzhou China Singapore Polytechnic Advanced Robotics and Intelligent Control Centre Singapore

ISBN: (纸本)9781665406970

The application of robots to assist humans in earthquake rescue has always been an important topic that researchers are constantly studying. CoSpace Rescue is an abstract modeling and simulation of earthquake rescue and a simulation platform for studying robot rescue search algorithms. Its mathematical model is a multi-objective optimization problem. In this paper, we propose a search algorithm design framework for the CoSpace Rescue robot. Based On this framework and the idea of the heuristic search algorithm, we design and implement the 'Multi-objective Optimal Dynamic Adaptive On-Demand Search Algorithm'. The results of the experiment show that the algorithm can dynamically adapt to the changes in the environment and significantly improve the search efficiency of the rescue robot. © 2021 IEEE.

关键词： Earthquakes

来源：评论

学校读者我要写书评

暂无评论

Novel Methods Inspired by Reinforcement Learning Actor-Critic Mechanism for Eye-in-Hand Calibration in robotics

Novel Methods Inspired by Reinforcement Learning Actor-Criti...

引用

IEEE International Conference on Development and Learning, ICDL

作者： Chenxing Li Yinlong Liu Yingbai Hu Fabian Schreier Jan Seyler Shahram Eivazi Department of Computer Science University of Tübingen Tübingen Germany Advanced Development Analytics and Control Festo SE and Co. KG Esslingen Germany State Key Laboratory of Internet of Things for Smart City (SKL-IOTSC) University of Macau Macau China HUA Cloud Intelligent Healthcare Co. Ltd. Ningbo China Multi-Scale Medical Robotics Centre and the Chow Yuk Ho Technology Centre for Innovative Medicine The Chinese University of Hong Kong Hong Kong China

Eye-in-hand camera calibration is an essential step in robotic vision systems. Traditional methods perform the calibration via geometry computation methods where the calibration points are acquired by moving the robot arm while capturing images of a static object (often a checkerboard) of known geometry. Our work aims to explore deep reinforcement learning (DRL) techniques for solving common calibration optimization problems. Inspired by the actor-critic mechanism of DRL, we propose a novel approach to perform eye-in-hand camera calibration on the robot arm. Numerical and real-world experiments prove the feasibility of the proposed method as such here we show the potential of the reinforcement learning method to solve the camera calibration problem.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：