检索结果-内蒙古大学图书馆

Preference detection of the humanoid robot face based on EEG and eye movement

Neural Computing and Applications 2024年第19期36卷 11603-11621页

作者： Wang, Pengchao Mu, Wei Zhan, Gege Wang, aiping Song, Zuoting Fang, Tao Zhang, Xueze Wang, Junkongshuai Niu, Lan Bin, Jianxiong Zhang, Lihua Jia, Jie Kang, Xiaoyang Laboratory for Neural Interface and Brain Computer Interface Engineering Research Center of AI and Robotics Ministry of Education Shanghai Engineering Research Center of AI and Robotics MOE Frontiers Center for Brain Science State Key Laboratory of Medical Neurobiology Institute of AI and Robotics Academy for Engineering and Technology Fudan University Shanghai200433 China Ji Hua Laboratory Guangdong Province Foshan528200 China Department of Rehabilitation Medicine Huashan Hospital Fudan University Shanghai200040 China Yiwu Research Institute of Fudan University Zhejiang Yiwu322000 China Research Center for Intelligent Sensing Zhejiang Lab Hangzhou311121 China

The face of a humanoid robot can affect the user experience, and the detection of face preference is particularly important. Preference detection belongs to a branch of emotion recognition that has received much attention from researchers. Most of the previous preference detection studies have been conducted based on a single modality. In this paper, we detect face preferences of humanoid robots based on electroencephalogram (EEG) signals and eye movement signals for single modality, canonical correlation analysis fusion modality, and bimodal deep autoencoder (BDAE) fusion modality, respectively. We validated the theory of frontal asymmetry by analyzing the preference patterns of EEG and found that participants had higher alpha wave energy for preference faces. In addition, hidden preferences extracted by EEG signals were better classified than preferences from participants' subjective feedback, and also, the classification performance of eye movement data was improved. Finally, experimental results showed that BDAE multimodal fusion using frontal alpha and beta power spectral densities and eye movement information as features performed best, with the highest average accuracy of 83.13% for the SVM and 71.09% for the KNN. © The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2024.

关键词： Electroencephalography

来源：评论

学校读者我要写书评

暂无评论

PhysORD: A Neuro-Symbolic Approach for Physics-infused Motion Prediction in Off-road Driving

PhysORD: A Neuro-Symbolic Approach for Physics-infused Motio...

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Zhipeng Zhao Bowen Li Yi Du Taimeng Fu Chen Wang Department of Computer Science and Engineering Spatial AI & Robotics (SAIR) Lab Institute for Artificial Intelligence and Data Science University at Buffalo Buffalo NY USA Robotics Institute Carnegie Mellon University Pittsburgh PA USA

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Motion prediction is critical for autonomous off-road driving, however, it presents significantly more challenges than on-road driving because of the complex interaction between the vehicle and the terrain. Traditional physics-based approaches encounter difficulties in accurately modeling dynamic systems and external disturbance. In contrast, data-driven neural networks require extensive datasets and struggle with explicitly capturing the fundamental physical laws, which can easily lead to poor generalization. By merging the advantages of both methods, neuro-symbolic approaches present a promising direction. These methods embed physical laws into neural models, potentially significantly improving generalization capabilities. However, no prior works were evaluated in real-world settings for off-road driving. To bridge this gap, we present PhysORD, a neural-symbolic approach integrating the conservation law, i.e., the Euler-Lagrange equation, into data-driven neural models for motion prediction in off-road driving. Our experiments showed that PhysORD can accurately predict vehicle motion and tolerate external disturbance by modeling uncertainties. It outperforms existing methods both in accuracy and efficiency and demonstrates data-efficient learning and generalization ability in long-term prediction.

关键词： Bridges Uncertainty Accuracy Neural networks Merging Predictive models Mathematical models Dynamical systems Intelligent robots

来源：评论

学校读者我要写书评

暂无评论

Learning-on-the-Drive: Self-supervised Adaptive Long-range Perception for High-speed Offroad Driving

Learning-on-the-Drive: Self-supervised Adaptive Long-range P...

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Eric Chen Cherie Ho Mukhtar Maulimov Chen Wang Sebastian Scherer Department of Computer Science and Mathematics Harvey Mudd College USA Robotics Institute Carnegie Mellon University USA Spatial AI & Robotics Lab University at Buffalo NY USA

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Autonomous offroad driving is essential for applications like emergency rescue, military operations, and agriculture. Despite progress, systems struggle with high-speed vehicles exceeding 10m/s due to the need for accurate long-range (> 50m) perception for safe navigation. Current approaches are limited by sensor constraints; LiDAR-based methods offer precise short-range data but are noisy beyond 30m, while visual models provide dense long-range measurements but falter with unseen scenarios. To overcome these issues, we introduce ALTER, a learning-on-the-drive perception framework that leverages both sensor types. ALTER uses a self-supervised visual model to learn and adapt from near-range LiDAR measurements, improving long-range prediction in new environments without manual labeling. It also includes a model selection module for better sensor failure response and adaptability to known environments. Testing in two real-world settings showed on average 43.4% better traversability prediction than LiDAR-only and 164% over non-adaptive state-of-the-art (SOTA) visual semantic methods after 45 seconds of online learning.

关键词： Adaptation models Visualization Laser radar Accuracy Soft sensors Semantics Predictive models Robot sensing systems Robustness Testing

来源：评论

学校读者我要写书评

暂无评论

Large Language Model Driven Interactive Learning for Real-Time Cognitive Load Prediction in Human-Swarm Systems

Large Language Model Driven Interactive Learning for Real-Ti...

引用

IEEE International Workshop on Robot and Human Communication (ROMAN)

作者： Wenshuo Zang Mengsha Hu Rui Liu Cognitive Robotics and AI Lab (CRAI) College of Aeronautics Engineering Department of Computer Science Kent State University OH USA

ISBN: (数字)9798350375022

ISBN: (纸本)9798350375039

The rapid advancements of drones have demonstrated the versatility and promising potential of human-swarm systems (HSS) across various domains. However, human performance within these systems may be impaired by factors such as limited domain knowledge and mental stress, often leading to cognitive overload and hindering the efficiency and effectiveness of human-swarm teaming. Consequently, the accurate monitoring of cognitive load levels is crucial for optimizing HSS performance. To address the challenges of existing measurement methods, which are often expensive, time-consuming, or lack real-time capabilities, we propose a Large Language Model driven cognitive load prediction framework. This framework integrates comprehensive task context, domain knowledge, and behavior analysis to provide fast and cost-effective predictions in complex scenarios. By leveraging the capabilities of Large Language Models and employing reinforcement learning to model the cognitive load generation, our framework aims to offer real-time insights into human-related factors causing high cognitive load and predict cognitive levels over time, ultimately enhancing the performance of HSS teaming.

关键词： Large language models Reinforcement learning Human factors Predictive models Cognitive load Real-time systems Robots Monitoring Load modeling Drones

来源：评论

学校读者我要写书评

暂无评论

iMTSP: Solving Min-Max Multiple Traveling Salesman Problem with Imperative Learning

iMTSP: Solving Min-Max Multiple Traveling Salesman Problem w...

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Yifan Guo Zhongqiang Ren Chen Wang Flight Dynamics & Control/Hybrid Systems Lab Purdue University West Lafayette IN Robotics Institute Carnegie Mellon University Pittsburgh PA USA Department of Computer Science and Engineering Spatial AI & Robotics (SAIR) Lab University at Buffalo NY USA

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

This paper considers a Min-Max Multiple Traveling Salesman Problem (MTSP), where the goal is to find a set of tours, one for each agent, to collectively visit all the cities while minimizing the length of the longest tour. Though MTSP has been widely studied, obtaining near-optimal solutions for large-scale problems is still challenging due to its NP-hardness. Recent efforts in data-driven methods face challenges of the need for hard-to-obtain supervision and issues with high variance in gradient estimations, leading to slow convergence and highly sub-optimal solutions. We address these issues by reformulating MTSP as a bilevel optimization problem, using the concept of imperative learning (IL). This involves introducing an allocation network that decomposes the MTSP into multiple single-agent traveling salesman problems (TSPs). The longest tour from these TSP solutions is then used to self-supervise the allocation network, resulting in a new self-supervised, bilevel, end-to-end learning framework, which we refer to as imperative MTSP (iMTSP). Additionally, to tackle the high-variance gradient issues during the optimization, we introduce a control variate-based gradient estimation algorithm. Our experiments showed that these innovative designs enable our gradient estimator to converge 20× faster than the advanced reinforcement learning baseline, and find up to 80% shorter tour length compared with Google OR-Tools MTSP solver, especially in large-scale problems (e.g. 1000 cities and 15 agents).

关键词： Urban areas Estimation Reinforcement learning Traveling salesman problems Internet Resource management Optimization Intelligent robots Faces Convergence

来源：评论

学校读者我要写书评

暂无评论

An Efficient Scene Coordinate Encoding and Relocalization Method

arXiv

引用

arXiv 2024年

作者： Xu, Kuan Jiang, Zeyu Cao, Haozhi Yuan, Shenghai Wang, Chen Xie, Lihua School of Electrical and Electronic Engineering Nanyang Technological University 50 Nanyang Avenue 639798 Singapore Spatial AI & Robotics Lab Department of Computer Science and Engineering University at Buffalo BuffaloNY14260 United States

Scene Coordinate Regression (SCR) is a visual localization technique that utilizes deep neural networks (DNN) to directly regress 2D-3D correspondences for camera pose estimation. However, current SCR methods often face challenges in handling repetitive textures and meaningless areas due to their reliance on implicit triangulation. In this paper, we propose an efficient scene coordinate encoding and relocalization method. Compared with the existing SCR methods, we design a unified architecture for both scene encoding and salient keypoint detection, enabling our system to focus on encoding informative regions, thereby significantly enhancing efficiency. Additionally, we introduce a mechanism that leverages sequential information during both map encoding and relocalization, which strengthens implicit triangulation, particularly in repetitive texture environments. Comprehensive experiments conducted across indoor and outdoor datasets demonstrate that the proposed system outperforms other state-of-the-art (SOTA) SCR methods. Our single-frame relocalization mode improves the recall rate of our baseline by 6.4% and increases the running speed from 56Hz to 90Hz. Furthermore, our sequence-based mode increases the recall rate by 11% while maintaining the original efficiency. Copyright © 2024, The Authors. All rights reserved.

关键词： Triangulation

来源：评论

学校读者我要写书评

暂无评论

ASFM: Augmented Social Force Model for Legged Robot Social Navigation 23

ASFM: Augmented Social Force Model for Legged Robot Social N...

引用

23rd IEEE-RAS International Conference on Humanoid Robots, Humanoids 2024

作者： Ægidius, Sebastian Chacón-Quesada, Rodrigo Delfaki, Andromachi Maria Kanoulas, Dimitrios Demiris, Yiannis Imperial College London Personal Robotics Lab Department of Electrical and Electronic Engineering LondonSW7 2AZ United Kingdom University College London Robot Perception and Learning Lab Department of Computer Science Gower Street LondonWC1E 6BT United Kingdom Ai Centre Department of Computer Science Ucl United Kingdom Archimedes/Athena Rc Greece

ISBN: (纸本)9798350373578

Social navigation in robotics primarily involves guiding mobile robots through human-populated areas, with pedestrian comfort balanced with efficient path-finding. Although progress has been seen in this field, a solution for the seamless integration of robots into pedestrian settings remains elusive. In this paper, a social force model for legged robots is developed, utilizing visual perception for human localization. In particular, an augmented social force model is introduced, incorporating refined interpretations of repulsive forces and avoidance behaviors based on pedestrian actions, alongside a target following mechanism. Experimental evaluation on a quadruped robot, through various scenarios, including interactions with oncoming pedestrians, crowds, and obstructed paths, demonstrates that the proposed augmented model significantly improves upon previous baseline methods in terms of chosen path length, average velocity, and time-to-goal for effective and efficient social navigation. The code isopen-source, while video demonstrations can be found on the project's webpage: https://***/ASFM/ © 2024 IEEE.

关键词： Mobile robots

来源：评论

学校读者我要写书评

暂无评论

airShot: Efficient Few-Shot Detection for Autonomous Exploration

AirShot: Efficient Few-Shot Detection for Autonomous Explora...

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Zihan Wang Bowen Li Chen Wang Sebastian Scherer Institute for Imaging Data and Communications School of Engineering The University of Edinburgh UK AirLab Robotics Institute Carnegie Mellon University Pittsburgh PA USA Department of Computer Science and Engineering Spatial AI & Robotics (SAIR) Lab Institute for Artificial Intelligence and Data Science University at Buffalo NY USA

ISBN: (数字)9798350377705

ISBN: (纸本)9798350377712

Few-shot object detection has drawn increasing attention in the field of robotic exploration, where robots are required to find unseen objects with a few online provided examples. Despite recent efforts have been made to yield online processing capabilities, slow inference speeds of low-powered robots fail to meet the demands of real-time detection-making them impractical for autonomous exploration. Existing methods still face performance and efficiency challenges, mainly due to unreliable features and exhaustive class loops. In this work, we propose a new paradigm airShot, and discover that, by fully exploiting the valuable correlation map, airShot can result in a more robust and faster few-shot object detection system, which is more applicable to robotics community. The core module Top Prediction Filter (TPF) can operate on multi-scale correlation maps in both the training and inference stages. During training, TPF supervises the generation of a more representative correlation map, while during inference, it reduces looping iterations by selecting top-ranked classes, thus cutting down on computational costs with better performance. Surprisingly, this dual functionality exhibits general effectiveness and efficiency on various off-the-shelf models. Exhaustive experiments on COCO2017, VOC2014, and SubT datasets demonstrate that TPF can significantly boost the efficacy and efficiency of most off-the-shelf models, achieving up to 36.4% precision improvements along with 56.3% faster inference speed. Code and Data are at: https://***/ImNotPrepared/airShot.

关键词： Training Correlation Codes Computational modeling Atmospheric modeling Object detection Real-time systems Computational efficiency Intelligent robots Faces

来源：评论

学校读者我要写书评

暂无评论

airSLAM: An Efficient and Illumination-Robust Point-Line Visual SLAM System

arXiv

引用

arXiv 2024年

作者： Xu, Kuan Hao, Yuefan Yuan, Shenghai Wang, Chen Xie, Lihua School of Electrical and Electronic Engineering Nanyang Technological University 50 Nanyang Avenue 639798 Singapore Spatial AI & Robotics Lab Computer Science and Engineering University at Buffalo BuffaloNY14260 United States

In this paper, we present an efficient visual SLAM system designed to tackle both short-term and long-term illumination challenges. Our system adopts a hybrid approach that combines deep learning techniques for feature detection and matching with traditional backend optimization methods. Specifically, we propose a unified convolutional neural network (CNN) that simultaneously extracts keypoints and structural lines. These features are then associated, matched, triangulated, and optimized in a coupled manner. Additionally, we introduce a lightweight relocalization pipeline that reuses the built map, where keypoints, lines, and a structure graph are used to match the query frame with the map. To enhance the applicability of the proposed system to real-world robots, we deploy and accelerate the feature detection and matching networks using C++ and NVIDIA TensorRT. Extensive experiments conducted on various datasets demonstrate that our system outperforms other state-of-the-art visual SLAM systems in illumination-challenging environments. Efficiency evaluations show that our system can run at a rate of 73Hz on a PC and 40Hz on an embedded platform. Our implementation is open-sourced: https://***/sair-lab/airSLAM. Copyright © 2024, The Authors. All rights reserved.

关键词： Convolutional neural networks

来源：评论

学校读者我要写书评

暂无评论

airLine: Efficient Learnable Line Detection with Local Edge Voting

AirLine: Efficient Learnable Line Detection with Local Edge ...

引用

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

作者： Xiao Lin Chen Wang College of Computing Georgia Institute of Technology Atlanta GA USA Department of Computer Science and Engineering Spatial AI & Robotics Lab State University of New York at Buffalo NY USA

Line detection is widely used in many robotic tasks such as scene recognition, 3D reconstruction, and simultaneous localization and mapping (SLAM). Compared to points, lines can provide both low-level and high-level geometrical information for downstream tasks. In this paper, we propose a novel learnable edge-based line detection algorithm, airLine, which can be applied to various tasks. In contrast to existing learnable endpoint-based methods, which are sensitive to the geometrical condition of environments, airLine can extract line segments directly from edges, resulting in a better generalization ability for unseen environments. To balance efficiency and accuracy, we introduce a region-grow algorithm and a local edge voting scheme for line parameterization. To the best of our knowledge, airLine is one of the first learnable edge-based line detection methods. Our extensive experiments have shown that it retains state-of-the-art-Ievel precision, yet with a $3-80\times$ runtime acceleration compared to other learning-based methods, which is critical for low-power robots.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：