检索结果-内蒙古大学图书馆

Preference detection of the humanoid robot face based on EEG and eye movement

Neural Computing and Applications 2024年第19期36卷 11603-11621页

作者： Wang, Pengchao Mu, Wei Zhan, Gege Wang, Aiping Song, Zuoting Fang, Tao Zhang, Xueze Wang, Junkongshuai Niu, Lan Bin, Jianxiong Zhang, Lihua Jia, Jie Kang, Xiaoyang Laboratory for Neural Interface and Brain Computer Interface Engineering Research Center of AI and Robotics Ministry of Education Shanghai Engineering Research Center of AI and Robotics MOE Frontiers Center for Brain Science State Key Laboratory of Medical Neurobiology Institute of AI and Robotics Academy for Engineering and Technology Fudan University Shanghai200433 China Ji Hua Laboratory Guangdong Province Foshan528200 China Department of Rehabilitation Medicine Huashan Hospital Fudan University Shanghai200040 China Yiwu Research Institute of Fudan University Zhejiang Yiwu322000 China Research Center for Intelligent Sensing Zhejiang Lab Hangzhou311121 China

The face of a humanoid robot can affect the user experience, and the detection of face preference is particularly important. Preference detection belongs to a branch of emotion recognition that has received much attention from researchers. Most of the previous preference detection studies have been conducted based on a single modality. In this paper, we detect face preferences of humanoid robots based on electroencephalogram (EEG) signals and eye movement signals for single modality, canonical correlation analysis fusion modality, and bimodal deep autoencoder (BDAE) fusion modality, respectively. We validated the theory of frontal asymmetry by analyzing the preference patterns of EEG and found that participants had higher alpha wave energy for preference faces. In addition, hidden preferences extracted by EEG signals were better classified than preferences from participants' subjective feedback, and also, the classification performance of eye movement data was improved. Finally, experimental results showed that BDAE multimodal fusion using frontal alpha and beta power spectral densities and eye movement information as features performed best, with the highest average accuracy of 83.13% for the SVM and 71.09% for the KNN. © The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2024.

关键词： Electroencephalography

来源：评论

学校读者我要写书评

暂无评论

EfficientNet-SAM: A Novel EffecientNet with Spatial Attention Mechanism for COVID-19 Detection in Pulmonary CT Scans

EfficientNet-SAM: A Novel EffecientNet with Spatial Attentio...

引用

IEEE computer Society Conference on computer Vision and Pattern Recognition Workshops (CVPRW)

作者： Ramy Farag Parth Upadhay Jacket Demby’s Yixiang Gao Katherin Garces Montoya Seyed Mohamad Ali Tousi Gbenga Omotara Guilherme DeSouza Department of Electrical Engineering and Computer Science Vision-Guided and Intelligent Robotics Lab - ViGIR Lab University of Missouri-Columbia

ISBN: (数字)9798350365474

ISBN: (纸本)9798350365481

Manual analysis and diagnosis of COVID-19 through the examination of Computed Tomography (CT) images of the lungs can be time-consuming and result in errors, especially given high volume of patients and numerous images per patient. So, we address the need for automation of this task by developing a new deep learning-based pipeline. Our motivation was sparked by the CVPR Workshop on "Domain Adaptation, Explainability and Fairness in AI for Medical Image Analysis", more specifically, the "COVID-19 Diagnosis Competition (DEF-AI-MIA COV19D)" under the same Workshop. This challenge provides an opportunity to assess our proposed pipeline for COVID-19 detection from CT scan images. The same pipeline incorporates one of the architectures in the EfficientNet "family", but with an added Spatial Attention Mechanism: EfficientNet-SAM. Also, unlike the traditional/past pipelines, which relied on a preprocessing step, our pipeline takes the raw selected input images without any such step, except for an image-selection step to simply reduce the number of CT images required for training and/or testing. Moreover, our pipeline is computationally efficient, as, for example, it does not incorporate a decoder for segmenting the lungs. It also does not combine different models nor combine RNN with a backbone, as other pipelines in the past did. Nevertheless, our pipeline outperformed all approaches presented by other teams in last year’s instance of the same challenge using the validation subset. It also placed 5th in this year’s competition, ranking less than 1.3% below the 1st place and close to 3.5% above the 6th place based on the macro-F1 score.

关键词： COVID-19 Training Visualization Attention mechanisms Computed tomography Conferences Pipelines

来源：评论

学校读者我要写书评

暂无评论

ASFM: Augmented Social Force Model for Legged Robot Social Navigation 23

ASFM: Augmented Social Force Model for Legged Robot Social N...

引用

23rd IEEE-RAS International Conference on Humanoid Robots, Humanoids 2024

作者： Ægidius, Sebastian Chacón-Quesada, Rodrigo Delfaki, Andromachi Maria Kanoulas, Dimitrios Demiris, Yiannis Imperial College London Personal Robotics Lab Department of Electrical and Electronic Engineering LondonSW7 2AZ United Kingdom University College London Robot Perception and Learning Lab Department of Computer Science Gower Street LondonWC1E 6BT United Kingdom Ai Centre Department of Computer Science Ucl United Kingdom Archimedes/Athena Rc Greece

ISBN: (纸本)9798350373578

Social navigation in robotics primarily involves guiding mobile robots through human-populated areas, with pedestrian comfort balanced with efficient path-finding. Although progress has been seen in this field, a solution for the seamless integration of robots into pedestrian settings remains elusive. In this paper, a social force model for legged robots is developed, utilizing visual perception for human localization. In particular, an augmented social force model is introduced, incorporating refined interpretations of repulsive forces and avoidance behaviors based on pedestrian actions, alongside a target following mechanism. Experimental evaluation on a quadruped robot, through various scenarios, including interactions with oncoming pedestrians, crowds, and obstructed paths, demonstrates that the proposed augmented model significantly improves upon previous baseline methods in terms of chosen path length, average velocity, and time-to-goal for effective and efficient social navigation. The code isopen-source, while video demonstrations can be found on the project's webpage: https://***/ASFM/ © 2024 IEEE.

关键词： Mobile robots

来源：评论

学校读者我要写书评

暂无评论

Integrating Function and Connection: Two Perspectives to Telepresence Robot Design for Classroom 25

Integrating Function and Connection: Two Perspectives to Tel...

引用

2025 ACM International Conference on Supporting Group Work, GROUP Companion 2025

作者： Berhane, Roda Akiode, Deo Adejoke Joshi, Swapna Elmimouni, Houda School of Informatics Computing and Engineering Indiana University BloomingtonIN United States Field Robotics Lab Northeastern University BostonMA United States Department of Computer Science University of Manitoba WinnipegMB Canada Information Systems and New Media University of Siegen Siegen Germany

ISBN: (纸本)9798400711879

This study explores robotic telepresence in classrooms, from the perspectives of both the remote students (operators) and their in-person classmates. Analyzing a subset of field study data from 35 participants (22 operators, 13 classmates), we identified differing priorities: operators of the robot emphasize the need for improved functional aspects like camera control, while co-present classmates value social presence, interaction and identification, advocating for features like personalization and effective communication channels. These insights underline the need for telepresence robots that balance functional efficacy with social integration to provide a holistic educational experience. This work, though incomplete, enriches Group and CSCW literature on telepresence robots to facilitate collaborative interactions by highlighting the distinct needs of remote and in-person students, proposing design recommendations for telepresence robots that are technically proficient and socially responsive. © 2025 Copyright held by the owner/author(s).

关键词： Students

来源：评论

学校读者我要写书评

暂无评论

Explorative Study on Motor Interference During Synchronous Human and Robot Arm Movements Under Varied Presence of a Robot Head

Explorative Study on Motor Interference During Synchronous H...

引用

IEEE International Conference on robotics and Biomimetics

作者： Mertcan Kaya Kolja Kühnlenz Robotics Research Lab Department of Electrical Engineering and Computer Science Coburg University of Applied Sciences and Arts Coburg Germany

ISBN: (数字)9798331509644

ISBN: (纸本)9798331509651

This paper investigates the influence of a static robot head on deviations of human hand movements from task direction (motor interference) during simultaneous human and robot arm movements using a collaborative robot arm. Synchronous vertical and horizontal human and robot arm movements are conducted in all combinations (within-subjects factors direction and congruency). The presence of the head (head/ no head) is varied as a between-subjects factor. In this first step, only its motionless presence is deliberately focused at, in order to exclude contributions by eye- or head-movement behavior or facial expressions being difficult variables to generalize from. Participants' hands are tracked optically marker-based and deviations from task-related vertical, respectively, horizontal movements are evaluated. In contrast to expectations, results do not show a significant impact of the robot head on motor interference. Thus, there is evidence, that appearance might not be an activating factor for motor interference in HRI.

关键词： Hands Tracking Neurons Humanoid robots Morphology Interference Motors Manipulators Mirrors Robots

来源：评论

学校读者我要写书评

暂无评论

Embracing Safe Contacts with Contact-aware Planning and Control

arXiv

引用

arXiv 2023年

作者： Li, Zhaoting Zamora, Miguel Zheng, Hehui Coros, Stelian Computational Robotics Lab Computer Science Department ETH Zurich Switzerland Soft Robotics Lab Department of Mechanical and Process Engineering ETH Zurich Switzerland

Unlike human beings that can employ the entire surface of their limbs as a means to establish contact with their environment, robots are typically programmed to interact with their environments via their end-effectors, in a collision-free fashion, to avoid damaging their environment. In a departure from such a traditional approach, this work presents a contact-aware controller for reference tracking that maintains interaction forces on the surface of the robot below a safety threshold in the presence of both rigid and soft contacts. Furthermore, we leveraged the proposed controller to extend the BiTRRT sample-based planning method to be contact-aware, using a simplified contact model. The effectiveness of our framework is demonstrated in hardware experiments using a Franka robot in a setup inspired by the Amazon stowing task. A demo video of our results can be seen here: https://***/2WeYytauhNg. © 2023, CC BY.

关键词： End effectors

来源：评论

学校读者我要写书评

暂无评论

Large Language Model Driven Interactive Learning for Real-Time Cognitive Load Prediction in Human-Swarm Systems

Large Language Model Driven Interactive Learning for Real-Ti...

引用

IEEE International Workshop on Robot and Human Communication (ROMAN)

作者： Wenshuo Zang Mengsha Hu Rui Liu Cognitive Robotics and AI Lab (CRAI) College of Aeronautics Engineering Department of Computer Science Kent State University OH USA

ISBN: (数字)9798350375022

ISBN: (纸本)9798350375039

The rapid advancements of drones have demonstrated the versatility and promising potential of human-swarm systems (HSS) across various domains. However, human performance within these systems may be impaired by factors such as limited domain knowledge and mental stress, often leading to cognitive overload and hindering the efficiency and effectiveness of human-swarm teaming. Consequently, the accurate monitoring of cognitive load levels is crucial for optimizing HSS performance. To address the challenges of existing measurement methods, which are often expensive, time-consuming, or lack real-time capabilities, we propose a Large Language Model driven cognitive load prediction framework. This framework integrates comprehensive task context, domain knowledge, and behavior analysis to provide fast and cost-effective predictions in complex scenarios. By leveraging the capabilities of Large Language Models and employing reinforcement learning to model the cognitive load generation, our framework aims to offer real-time insights into human-related factors causing high cognitive load and predict cognitive levels over time, ultimately enhancing the performance of HSS teaming.

关键词： Large language models Reinforcement learning Human factors Predictive models Cognitive load Real-time systems Robots Monitoring Load modeling Drones

来源：评论

学校读者我要写书评

暂无评论

Sampling-Based Model Predictive Control for Dexterous Manipulation on a Biomimetic Tendon-Driven Hand

arXiv

引用

arXiv 2024年

作者： Hess, Adrian Kübler, Alexander M. Forrai, Benedek Dogar, Mehmet Katzschmann, Robert K. Robotics Lab Department of Mechanical and Process Engineering ETH Zurich Switzerland School of Computer Science University of Leeds United Kingdom

Biomimetic and compliant robotic hands offer the potential for human-like dexterity, but controlling them is challenging due to high dimensionality, complex contact interactions, and uncertainties in state estimation. Sampling-based model predictive control (MPC), using a physics simulator as the dynamics model, is a promising approach for generating contact-rich behavior. However, sampling-based MPC has yet to be evaluated on physical (non-simulated) robotic hands, particularly on compliant hands with state uncertainties. We present the first successful demonstration of in-hand manipulation on a physical biomimetic tendon-driven robot hand using sampling-based MPC. While sampling-based MPC does not require lengthy training cycles like reinforcement learning approaches, it still necessitates adapting the task-specific objective function to ensure robust behavior execution on physical hardware. To adapt the objective function, we integrate a visual language model (VLM) with a real-time optimizer (MuJoCo MPC). We provide the VLM with a high-level human language description of the task, and a video of the hand’s current behavior. The VLM gradually adapts the objective function, allowing for efficient behavior generation, with each iteration taking less than two minutes. In our experiments, the hand achieves an average ball rolling speed of 0.35 rad/s, successful ball flips, and catching with a 67% success rate. Our results demonstrate that sampling-based MPC is a promising approach for generating dexterous manipulation skills on biomimetic hands without extensive training cycles. © 2024, CC BY.

关键词： Visual languages

来源：评论

学校读者我要写书评

暂无评论

Design and Implementation of an On-Board System for a Spider Robot 1st

Design and Implementation of an On-Board System for a Spider...

引用

1st International Conference on Computing and Emerging Technologies, ICCET 2023

作者： Nauman, Nasir Mustafa, Hirra Ashraf, Abrar Khalil, Hisham Department of Computer Science Superior University Lahore Pakistan Department of Computer Science Sharif College of Engineering and Technology Lahore Lahore Pakistan Embedded System and Robotics Lab Department of Technology The University of Lahore Lahore Pakistan

ISBN: (纸本)9783031776199

This paper presents the design of a system onboard spider robot for rescue services. The spider has the six-leg walking pattern that contains the total number of 18 servo motors. In order to reduce the payload, the abdomen of the spider is made with RF4 printed circuit board (PCB). Whereas, the abdomen is also used as the main structure of the robot to attach the rest of the system. Wherein, two pulse-width modulations (PWM) module are controlled by Arduino Nano, the Bluetooth module is used for communication link and bulk converter for the power supply. The spider robot is operated with an in-house developed Android application. It has been observed that the spider robot has a stable walking response along with the multiple excise performance. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

关键词： Machine design

来源：评论

学校读者我要写书评

暂无评论

Single Robot Multitasking Through Dynamic Resource Allocation

Single Robot Multitasking Through Dynamic Resource Allocatio...

引用

IEEE-RAS International Conference on Humanoid Robots

作者： Tyler Becker Song Jiang David Feil-Seifer Monica Nicolescu Department of Computer Science & Engineering Robotics Research lab University of Nevada Reno Reno NV USA Department of Computer Science & Engineering Socially Assistive Robotics Group University of Nevada Reno Reno NV USA

This paper addresses the problem of dynamic allocation of robot resources to tasks with hierarchical representations and multiple types of execution constraints, with the goal of enabling single-robot multitasking capabilities. Although the vast majority of robot platforms are equipped with more than one sensor (cameras, lasers, sonars) and several actuators (wheels/legs, two arms), which would in principle allow the robot to concurrently work on multiple tasks, existing methods are limited to allocating robots in their entirety to only one task at a time. This approach employs only a subset of a robot's sensors and actuators, leaving other robot resources unused. Our aim is to enable a robot to make full use of its capabilities by having an individual robot multitask, distributing its sensors and actuators to multiple concurrent activities. We propose a new architectural framework based on Hierarchical Task Trees that supports multitasking through a new representation of robot behaviors that explicitly encodes the robot resources (sensors and actuators) and the environmental conditions needed for execution. This architecture was validated on a two-arm, mobile, PR2 humanoid robot, performing tasks with multiple types of execution constraints.

关键词：

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：