检索结果-内蒙古大学图书馆

A Survey of Human Action Recognition and Posture Prediction

Tsinghua Science and Technology 2022年第6期27卷 973-1001页

作者： Nan Ma Zhixuan Wu Yiu-ming Cheung Yuchen Guo Yue Gao Jiahong Li Beiyan Jiang Beijing Key Laboratory of Information Service Engineering the College of RoboticsBeijing Union UniversityBeijing 100101China Department of Computer Science Hong Kong Baptist UniversityHong Kong 999077China Beijing National Research Center for Information Science and Technology Tsinghua UniversityBeijing 100084China School of Software Tsinghua UniversityBeijing 100084China College of Robotics Beijing Union UniversityBeijing 100101China

Human action recognition and posture prediction aim to recognize and predict respectively the action and postures of persons in *** are both active research topics in computer vision community,which have attracted considerable attention from academia and *** are also the precondition for intelligent interaction and human-computer cooperation,and they help the machine perceive the external *** the past decade,tremendous progress has been made in the field,especially after the emergence of deep learning ***,it is necessary to make a comprehensive review of recent *** this paper,firstly,we attempt to present the background,and then discuss research ***,we introduce datasets,various typical feature representation methods,and explore advanced human action recognition and posture prediction ***,facing the challenges in the field,this paper puts forward the research focus,and introduces the importance of action recognition and posture prediction by taking interactive cognition in self-driving vehicle as an example.

关键词： human action recognition posture prediction computer vision human-computer cooperation interactive cognition

来源：评论

学校读者我要写书评

暂无评论

Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimation

引用

IEEE Transactions on Pattern Analysis and Machine Intelligence 2025年第7期47卷 5520-5537页

作者： Jian Liu Wei Sun Hui Yang Pengchao Deng Chongpei Liu Nicu Sebe Hossein Rahmani Ajmal Mian National Engineering Research Center for Robot Visual Perception and Control Technology College of Electrical and Information Engineering School of Robotics and the State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body Hunan University Changsha China Institute of Artificial Intelligence and Robotics Xi’an Jiaotong University Xi’an China Department of Information Engineering and Computer Science University of Trento Trento Italy School of Computing and Communications Lancaster University Lancaster U.K. Department of Computer Science The University of Western Australia Crawley WA Australia

Nine-degrees-of-freedom (9-DoF) object pose and size estimation is crucial for enabling augmented reality and robotic manipulation. Category-level methods have received extensive research attention due to their potential for generalization to intra-class unknown objects. However, these methods require manual collection and labeling of large-scale real-world training data. To address this problem, we introduce a diffusion-based paradigm for domain-generalized category-level 9-DoF object pose estimation. Our motivation is to leverage the latent generalization ability of the diffusion model to address the domain generalization challenge in object pose estimation. This entails training the model exclusively on rendered synthetic data to achieve generalization to real-world scenes. We propose an effective diffusion model to redefine 9-DoF object pose estimation from a generative perspective. Our model does not require any 3D shape priors during training or inference. By employing the Denoising Diffusion Implicit Model, we demonstrate that the reverse diffusion process can be executed in as few as 3 steps, achieving near real-time performance. Finally, we design a robotic grasping system comprising both hardware and software components. Through comprehensive experiments on two benchmark datasets and the real-world robotic system, we show that our method achieves state-of-the-art domain generalization performance.

关键词： Shape Solid modeling Three-dimensional displays Pose estimation Training Robots Grasping Diffusion models Real-time systems Point cloud compression

来源：评论

学校读者我要写书评

暂无评论

Adaptive Block Elevation Mapping for Large-scale Scene

Adaptive Block Elevation Mapping for Large-scale Scene

引用

2022 IEEE International Conference on robotics and Biomimetics, ROBIO 2022

作者： Zhou, Yang Zhu, Shiqiang Huang, Huang Li, Yuehua Gu, Jason The Research Center for Intelligent Robotics Research Institute of Interdisciplinary Innovation Zhejiang Laboratory Hangzhou311100 China Zhejiang Engineering Research Center for Intelligent Robotics Hangzhou311100 China The Beijing Institute of Control Engineering Beijing100094 China The Beijing Research Institute Zhejiang Laboratory Beijing100094 China The Department of Electrical and Computer Engineering Dalhousie University HalifaxNSB3H 4R2 Canada

ISBN: (纸本)9781665481090

Dense map that contains the surrounding geometry and vision information of a robot is widely used for path planning, navigation, obstacle avoidance and other applications. Considering the performance of the processing unit mounted on the robot is limited, mapping algorithm has to make compromise by sacrificing speed and precision. It will be more challenging when the dense mapping scene is very large because the memory consumption will be greatly increased and the map is difficult to be extended if beyonding the initial map. To suppress the negative impact from the increased map scale, we proposed a novel block mapping approach to generate the dense map in large scale of scene. In this work, the elevation map is selected as the base dense map. The entire elevation map is segmented into numerous block maps of which size is much smaller than that of the entire map. The present moment of lidar and vision measurements are used to generate the local elevation map. The local elevation map is used to update block maps which are adaptively generated along the motion trajectory. A memory-disk interaction mechanism, which the block maps will be loaded to memory or saved to local disk when needed, is introduced. Our block mapping approach is tested on the KITTI datasets, and the results demonstrate that the mapping approach can stably operate in a large scale of scene with a much smaller consumption of memory. © 2022 IEEE.

关键词： Motion planning

来源：评论

学校读者我要写书评

暂无评论

Convergent effects of peptides on the initiation of feeding motor programs in the mollusk Aplysia

引用

Journal of Neurophysiology 2025年第5期133卷 1368-1379页

作者： Evans, Colin G. Barry, Michael A. Reaver, Carrie N. Patel, Paras R. Chestek, Cynthia A. Perkins, Matthew H. Jing, Jian Cropper, Elizabeth C. Department of Neuroscience Friedman Brain Institute Icahn School of Medicine at Mount Sinai New York NY United States Department of Biomedical Engineering Biointerfaces Institute University of Michigan Ann Arbor MI United States Department of Electrical Engineering and Computer Science Neurosciences Program Robotics Program University of Michigan Ann Arbor MI United States State Key Laboratory of Pharmaceutical Biotechnology Institute for Brain Sciences Chemistry and Biomedicine Innovation Center Jiangsu Engineering Research Center for MicroRNA Biology and Biotechnology Advanced Institute for Life Sciences School of Life Sciences Nanjing University Nanjing China

Neuropeptides configure the feeding network of Aplysia. For example, egestive activity is promoted by small cardioactive peptide (SCP), and ingestive activity is promoted by a combination of feeding circuit activating peptide (FCAP) and cerebral peptide 2 (CP-2). In addition, SCP and FCAP/CP-2 have a common network effect that does not contribute to motor program specification. They increase the excitability of an interneuron, B63. In this report, we further characterized the effects of peptides on B63. We performed voltage-clamp experiments and used a step protocol to look at steady-state currents. We found that SCP and FCAP/CP-2 both induced an inward current that was virtually absent in low-sodium saline. Previous work has established that B63 is unusual in the feeding circuit in that subthreshold depolarizations are autonomously generated that can trigger motor programs. Here, we show that this autonomous activity is more frequent in the presence of peptides. Previous studies have also shown that activity of the feeding central pattern generator (CPG) can be initiated by neurons that excite B63, e.g., by cerebral buccal interneuron 2 (CBI-2), a projection neuron that triggers biting-like motor programs. Here, we show that the latency of CBI-2-induced activity is decreased by stimulation of the esophageal nerve (EN) (which releases endogenous SCP). These results, taken together with previous results, indicate that peptides that act divergently to configure network activity additionally act convergently to promote motor program induction. We present data that suggest that this arrangement facilitates brief switches between ingestive and egestive motor activity. © 2025 The Authors.

关键词： central pattern generator invertebrate modulation motor program neuropeptide

来源：评论

学校读者我要写书评

暂无评论

Graph-Based Visual-Kinematic Fusion and Monte Carlo Initialization for Fast-Deployable Cable-Driven Robots

Graph-Based Visual-Kinematic Fusion and Monte Carlo Initiali...

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： R. Khorrambakht H. Damirchi M.R. Dindarloo A. Saki S.A. Khalilpour Hamid D. Taghirad Stephan Weiss Electrical & Computer Engineering Department Control/Robotics Research Laboratory Tandon School of Engineering New York University Brooklyn NY School of Computer Science University of Adelaide Australia Faculty of Electrical Engineering University of Technology Tehran Iran Department of Smart Systems Technologies University of Klagenfurt Austria

Ease of calibration and high-accuracy task-space state-estimation purely based on onboard sensors is a key requirement for enabling easily deployable cable robots in real-world applications. In this work, we incorporate the onboard camera and kinematic sensors to drive a statistical fusion framework that presents a unified localization and calibration system which requires no initial values for the kinematic parameters. This is achieved by formulating a Monte-Carlo algorithm that initializes a factor-graph representation of the calibration and localization problem. With this, we are able to jointly identify both the kinematic parameters and the visual odometry scale alongside their corresponding uncertainties. We demonstrate the practical applicability of the framework using our state-estimation dataset recorded with the ARAS-CAM suspended cable driven parallel robot, and published as part of this manuscript.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Fuzzy Object Ambiguity Determination and Human Attention Assessment for Domestic Service Robots

Fuzzy Object Ambiguity Determination and Human Attention Ass...

引用

International Conference on Soft Computing and Machine Intelligence (ISCMI)

作者： Kevin Fan Melanie Jouaiti Kerstin Dautenhahn Chrystopher L. Nehaniv Department of Electrical & Computer Engineering and Systems Design Engineering Social and Intelligent Robotics Research Laboratory (SIRRL) University of Waterloo Waterloo Canada Departments of Electrical & Computer Engineering and Systems Design Engineering Social and Intelligent Robotics Research Laboratory (SIRRL) University of Waterloo Waterloo Canada

Domestic service robots have the promising potential of bringing significant services to the general population, and more importantly, successful applications of universal domestic service robots can potentially help mitigate critical societal issues such as senior care. In order to do so, domestic service robots need to integrate seamlessly into home environments. However, home environments are dynamic, complex and filled with personal items. Therefore, ambiguity can quickly arise for robots operating in such rich environments. In this paper, we propose an object ambiguity determination system that can determine the level of ambiguity in robot object selection tasks with fuzzy logic data integration. Additionally, we propose a functional human attention assessment system with fuzzy logic that enables the robot to determine user attention before committing to general disambiguation processes. Our preliminary results show that the proposed fuzzy logic inference systems can reliably estimate the robot object selection task ambiguity from object confidence level and the number of potential target objects that satisfy the user's command. Furthermore, fuzzy inference is applied to decide human eye gaze direction robustly. These subsystems can be utilized in the context of human-robot interaction to guide the robot when to seek feedback from a human partner in order to disambiguate reference in domestic service tasks. The source code of all proposed systems is available publicly on GitHub. 1

关键词： Fuzzy logic Service robots Source coding Sociology Human-robot interaction Data integration Reliability

来源：评论

学校读者我要写书评

暂无评论

High-precision Calibration of Camera and IMU on Manipulator for Bio-inspired Robotic System

引用

Journal of Bionic engineering 2022年第2期19卷 299-313页

作者： Yinlong Zhang Wei Liang Sichao Zhang Xudong Yuan Xiaofang Xia Jindong Tan Zhibo Pang State Key Laboratory of Robotics Shenyang Institute of AutomationChinese Academy of SciencesShenyang 110016China Key Laboratory of Networked Control Systems Chinese Academy of SciencesShenyang 110016China Institutes for Robotics and Intelligent Manufacturing Chinese Academy of SciencesShenyang 110169China The School of Computer Science and Technology Xidian UniversityXi’an 710071China Department of Mechanical Aerospace and Biomedical EngineeringUniversity of TennesseeKonxville 37996USA Department of Automation Technology ABB Corporate Research Sweden72178 VästerasSweden

Inspired by box jellyfish that has distributed and complementary perceptive system,we seek to equip manipulator with a camera and an Inertial Measurement Unit(IMU)to perceive ego motion and surrounding unstructured *** robot perception,a reliable and high-precision calibration between camera,IMU and manipulator is a critical *** paper introduces a novel calibration ***,we seek to correlate the spatial relationship between the sensing units and manipulator in a joint ***,the manipulator moving trajectory is elaborately designed in a spiral pattern that enables full excitations on yaw-pitch-roll rotations and x-y-z translations in a repeatable and consistent *** calibration has been evaluated on our collected visual inertial-manipulator *** systematic comparisons and analysis indicate the consistency,precision and effectiveness of our proposed calibration method.

关键词： Bio-inspired robotic system Monocular camera IMU Manipulator Calibration

来源：评论

学校读者我要写书评

暂无评论

A Target-based Calibration Method for LiDAR-Visual-Thermal Multi-Sensor System

A Target-based Calibration Method for LiDAR-Visual-Thermal M...

引用

2022 IEEE International Conference on robotics and Biomimetics, ROBIO 2022

作者： Yuan, Songyu Xie, Tian Zhu, Shiqiang Chen, Yeheng Li, Yuehua Zheng, Tao Gu, Jason Research Center for Intelligent Robotics Research Institute of Interdis-ciplinary Innovation Zhejiang Lab Hangzhou311100 China Zhejiang Engineering Research Center for Intelligent Robotics Hangzhou311100 China Dalhousie University Department of Electrical and Computer Engineering HalifaxNSB3H 4R2 Canada

ISBN: (纸本)9781665481090

As the basis of multi-sensor fusion, accurate extrinsic calibration among multi-sensors is vital for hetero-geneous information fusion. However, most existing methods only focus on the calibration between two specific heteroge-neous sensors, such as camera-LiDAR, LiDAR-thermal, and etc. which may cause inevitable accumulation when applied to a multi-sensor system. To address this problem, a novel calibration target and a high-accuracy method are proposed to simultaneously calibrate the intrinsic and extrinsic of a 3D LiDAR, a thermal camera and a visible camera without any user intervention. The proposed method only relies on one calibration board, to calibrate all the intrinsic and extrinsic parameters in one-step, without any strict pose requirement or long-time optimization. Furthermore, 2D-3D corresponding features can be extracted with higher precision by considering sensor model, comparing to the common feature extraction methods. Experiments with Velodyne VLP-16 LiDAR, ZED camera and D843NT thermal camera demonstrate that the proposed method can complete calibration among three of them automatically. Finally, this paper also presents a target-based method of uniformly expressing the calibration errors among multi-sensor system, with a competitive performance against most state-of-the-art methods. © 2022 IEEE.

关键词： Calibration

来源：评论

学校读者我要写书评

暂无评论

Learning a Better Control Barrier Function

Learning a Better Control Barrier Function

引用

IEEE Conference on Decision and Control

作者： Bolun Dai Prashanth Krishnamurthy Farshad Khorrami Electrical & Computer Engineering Department Control/Robotics Research Laboratory Tandon School of Engineering New York University Brooklyn NY

ISBN: (数字)9781665467612

ISBN: (纸本)9781665467629

Control barrier functions (CBFs) are widely used in safety-critical controllers. However, constructing a valid CBF is challenging, especially under nonlinear or non-convex constraints and for high relative degree systems. Meanwhile, finding a conservative CBF that only recovers a portion of the true safe set is usually possible. In this work, starting from a "conservative" handcrafted CBF (HCBF), we develop a method to find a CBF that recovers a reasonably larger portion of the safe set. Since the learned CBF controller is not guaranteed to be safe during training iterations, we use a model predictive controller (MPC) to ensure safety during training. Using the collected trajectory data containing safe and unsafe interactions, we train a neural network to estimate the difference between the HCBF and a CBF that recovers a closer solution to the true safe set. With our proposed approach, we can generate safe controllers that are less conservative and computationally more efficient. We validate our approach on two systems: a second-order integrator and a ball-on-beam.

关键词： Training Heuristic algorithms Neural networks Predictive models Data collection Data models Safety

来源：评论

学校读者我要写书评

暂无评论

A computer Vision Approach to Plant Growth Monitoring in an Embedded CubeSat Module

A Computer Vision Approach to Plant Growth Monitoring in an ...

引用

IEEE Conference on Aerospace

作者： Alexis Lopez Olaoluwayimika Olugbenle Michael C.F. Bazzocchi Department of Mechanical and Aerospace Engineering Astronautics and Robotics Laboratory (ASTRO Lab) Clarkson University Potsdam NY USA Department of Electrical and Computer Engineering Astronautics and Robotics Laboratory (ASTRO Lab) Clarkson University Potsdam NY USA Department of Mechanical and Aerospace Engineering Astronautics and Robotics Laboratory (ASTRO Lab) Clarkson University Potsdam NY Department of Earth and Space Science and Engineering York University Toronto Canada

The investigation and development of space-based food production systems are essential to improve the reliability and availability of fresh sustenance for astronauts. With their compact size and low-cost production, CubeSats can provide a unique platform for plant-based in-space experiments. Additionally, the combination of CubeSats and computer vision can allow for monitoring the health of plants during their growth cycles. This paper investigates the electronics and data handling of a crop growth module, otherwise referred to as an environmental monitoring and control subsystem (EMCS), as well as the integration of computer vision techniques for plant growth and development. Using the Otsu thresholding and holistically-nested edge detection algorithms, image segmentation and edge detection were performed, respectively. A support vector machine (SVM) was also employed to classify foliage and provide feedback on the plant’s health. The results from the system show that the computer vision approach can accurately predict the health of the plants based on color and texture. This study builds a foundation for future plant health monitoring research in deep space environments.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：