检索结果-内蒙古大学图书馆

Automatic interaction and Activity Recognition from Videos of human Manual Demonstrations with Application to Anomaly Detection

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Merlo, Elena Lagomarsino, Marta Lamon, Edoardo Ajoudani, Arash Human-Robot Interfaces and Interaction Laboratory Istituto Italiano di Tecnologia Genoa Italy Dept. of Informatics Bioengineering Robotics and Systems Engineering University of Genoa Genoa Italy Dept. of Electronics Information and Bioengineering Politecnico di Milano Milan Italy Dept. of Information Engineering and Computer Science University of Trento Trento Italy

This paper presents a new method to describe spatio-temporal relations between objects and hands, to recognize both interactions and activities within video demonstrations of manual tasks. The approach exploits Scene Graphs to extract key interaction features from image sequences while simultaneously encoding motion patterns and context. Additionally, the method introduces event-based automatic video segmentation and clustering, which allow for the grouping of similar events and detect if a monitored activity is executed correctly. The effectiveness of the approach was demonstrated in two multi-subject experiments, showing the ability to recognize and cluster hand-object and object-object interactions without prior knowledge of the activity, as well as matching the same activity performed by different subjects. Copyright © 2023, The Authors. All rights reserved.

关键词： Anomaly detection

Automatic interaction and Activity Recognition from Videos of human Manual Demonstrations with Application to Anomaly Detection

学校读者我要写书评

暂无评论

Automatic Interaction and Activity Recognition from Videos o...

IEEE International Workshop on Robot and human Communication (ROMAN)

作者： Elena Merlo Marta Lagomarsino Edoardo Lamon Arash Ajoudani Human-Robot Interfaces and Interaction Laboratory Istituto Italiano di Tecnologia Genoa Italy Dept. of Informatics Bioengineering Robotics and Systems Engineering University of Genoa Genoa Italy Dept. of Electronics Information and Bioengineering Politecnico di Milano Milan Italy Dept. of Information Engineering and Computer Science University of Trento Trento Italy

关键词：

Structural and functional neural correlates of sensorimotor deficits in progression of hepatic encephalopathy

学校读者我要写书评

暂无评论

Magnetic Resonance Letters 2025年第2期5卷 1-10页

作者： Sha, Guanchen Liu, Yuefan Cao, Yutong Zhang, Qi Zhang, Yining Chen, Yuanyuan Fan, Qiuyun Cheng, Yue Department of Biomedical Engineering College of Precision Instruments and Optoelectronics Engineering Tianjin University Tianjin300072 China Tianjin Key Laboratory of Brain Science and Neuroengineering Tianjin300072 China Academy of Medical Engineering and Translational Medicine Tianjin University Tianjin300072 China Department of Medical Imaging Tianjin First Central Hospital Tianjin300192 China Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration Tianjin300392 China State Key Laboratory of Advanced Medical Materials and Devices Tianjin300072 China

Hepatic encephalopathy (HE) is a neurological condition that occurs as a complication of liver dysfunction that involves sensorimotor symptoms in addition to cognitive and behavioral changes, particularly in cases of severe liver disease or cirrhosis. Previous studies have reported spatially distributed structural and functional abnormalities related to HE, but the exact relationship between the structural and functional alterations with respect to disease progression remains unclear. In this study, we performed surface-based cortical thickness comparisons and functional connectivity (FC) analyses between three cross-sectional groups: healthy controls (HC, N = 51), patients with minimal hepatic encephalopathy (MHE, N = 50), patients with overt hepatic encephalopathy (OHE, N = 51). In addition to the distributed cortical thinning that is extensively thought to be associated with cognitive decline in HE, we found significant cortical thickening in the left parahippocampal gyrus cortex in the OHE group (p © 2025 The Authors

关键词： Diseases

Rapid convergence: The outcomes of making ppe during a healthcare crisis

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Mack, Kelly Hofmann, Megan Lakshmi, Udaya Cao, Jerry Auradkar, Nayha Arriaga, Rosa I. Hudson, Scott E. Mankoff, Jennifer Paul G. Allen School of Computer Science University of Washington SeattleWA United States Human Computer Interaction Institute Carnegie Mellon University PittsburghPA United States School of Interactive Computing Georgia Institute of Technology AtlantaGA United States Paul G. Allen School of Computer Science University of Washington SeattleWA United States Human Computer Interaction Institute Carnegie Mellon University PittsburghPA United States Paul G. Allen School of Computer Science University of Washington SeattleWA United States

The NIH 3D Print Exchange is a public and open source repository for primarily 3D printable medical device designs with contributions from expert-amateur makers, engineers from industry and academia, and clinicians. In response to the COVID-19 pandemic, a collection was formed to foster submissions of low-cost, local manufacture of personal protective equipment (Personal Protective Equipment (PPE)). We systematically evaluated the 623 submissions in this collection to understand: what makers contributed, how they were made, who made them, and key characteristics of their designs. Our analysis reveals an immediate design convergence to derivatives of a few initial designs affiliated with NIH partners (e.g., universities, the Veteran’s Health Administration, America Makes) and major for-profit groups (e.g., Prusa). The NIH worked to review safe and effective designs but was quickly overloaded by derivative works. We found that the vast majority were never reviewed (81.3%) while 10.4% of those reviewed were deemed safe for clinical (5.6%) or community use (4.8%). Our work contributes insights into: the outcomes of distributed, community-based, medical making;features the community accepted as "safe" making;and how platforms can support regulated maker activities in high-risk domains (e.g., healthcare). © 2021, CC BY.

关键词： Health care

What if it speaks like it was from the village? Effects of a Robot speaking in Regional Language Variations on Users’ Evaluations

学校读者我要写书评

暂无评论

What if it speaks like it was from the village? Effects of a...

IEEE International Workshop on Robot and human Communication (ROMAN)

作者： Birgit Lugrin Elisabeth Ströle David Obremski Frank Schwab Benjamin Lange Human-Computer Interaction Institute of Computer Science University of Würzburg Media Psychology Instutute Human Computer Media University of Würzburg

ISBN: (数字)9781728160757

ISBN: (纸本)9781728160764

The present contribution investigates the effects of spoken language varieties, in particular non-standard / regional language compared to standard language (in our study: High German), in social robotics. Based on (media) psychological and sociolinguistic research, we assumed that a robot speaking in regional language (i.e., dialect and regional accent) would be considered less competent compared to the same robot speaking in standard language (H1). Contrarily, we assumed that regional language might enhance perceived social skills and likability of a robot, at least so when taking into account whether and how much the human observers making the evaluations talk in regional language themselves. More precisely, it was assumed that the more the study participants spoke in regional language, the better their ratings of the dialect-speaking robot on social skills and likeability would be (H2). We also investigated whether the robot's gender (male vs. female voice) would have an effect on the ratings (RQ). H1 received full, H2 limited empirical support by the data, while the robot's gender (RQ) turned out to be a mostly negligible factor. Based on our results, practical implications for robots speaking in regional language varieties are suggested.

关键词：

A Novel Lightweight Convolutional Neural Network for EEG-Based Miniature-Event-Related Potentials

学校读者我要写书评

暂无评论

A Novel Lightweight Convolutional Neural Network for EEG-Bas...

IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications

作者： Chang Liu Wenxiao Zhong Yang Di Liang Zhao Xingwei An Academy of Medical Engineering and Translational Medicine Tianjin University Tianjin P. R. China Tianjin Key Laboratory of Brain Science and Neuroengineering academy of medical engineering and translation of medicine Tianjin University Tianjin Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration State Key Laboratory of Advanced Medical Materials and Devices Tianjin University Tianjin Tianjin P. R. China

ISBN: (数字)9798350322996

ISBN: (纸本)9798350323009

Miniature asymmetric visual evoked potential (aVEP) induced by very small lateral visual stimuli is a comfortable stimulation paradigm. It could only induce a miniature potential about 0.5 μV in amplitude, which could be challenging to detect. Most decoding methods based on miniature aVEP are machine learning approaches, and deep learning methods have not yet been introduced. Therefore, this paper introduces deep learning techniques for the first time and designs a lightweight convolutional neural network. Specifically, depthwise convolution is employed to reduce the number of network parameters and extract temporal and spatial features from EEG signals. The model achieves an average classification accuracy of 78.48% on the miniature aVEP dataset, which is 1.14% higher than the previous state-of-the-art model, DCPM. Through comparison with other deep learning models in terms of parameter count, computational complexity, and classification accuracy, it is evident that the proposed model surpasses them in all these aspects The results suggest that the CNN model proposed in this study achieves high classification accuracy while demanding fewer computational resources. Although the network model we proposed is very simple, it can achieve good results in processing miniature aVEP. In future research, we will continue to improve this lightweight network to enhance its decoding performance for miniature aVEP.

关键词： Deep learning Visualization Accuracy Computational modeling Neural networks Virtual environments Brain modeling

Span-level Emotion-Cause-Category Triplet Extraction with Instruction Tuning LLMs and Data Augmentation

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Li, Xiangju Yang, Dong Zhu, Xiaogang Huang, Faliang Zhang, Peng Zhao, Zhongying College of Computer Science and Engineering Shandong University of Science and Technology Qingdao266500 China Guangxi Key Lab of Human-machine Interaction and Intelligent Decision Nanning Normal University Nanning530100 China

Span-level emotion-cause-category triplet extraction represents a novel and complex challenge within emotion cause analysis. This task involves identifying emotion spans, cause spans, and their associated emotion categories within the text to form structured triplets. While prior research has predominantly concentrated on clause-level emotion-cause pair extraction and span-level emotion-cause detection, these methods often confront challenges originating from redundant information retrieval and difficulty in accurately determining emotion categories, particularly when emotions are expressed implicitly or ambiguously. To overcome these challenges, this study explores a fine-grained approach to span-level emotion-cause-category triplet extraction and introduces an innovative framework that leverages instruction tuning and data augmentation techniques based on large language models. The proposed method employs task-specific triplet extraction instructions and utilizes low-rank adaptation to fine-tune large language models, eliminating the necessity for intricate task-specific architectures. Furthermore, a prompt-based data augmentation strategy is developed to address data scarcity by guiding large language models in generating high-quality synthetic training data. Extensive experimental evaluations demonstrate that the proposed approach significantly outperforms existing baseline methods, achieving at least a 12.8% improvement in span-level emotion-cause-category triplet extraction metrics. The results demonstrate the method’s effectiveness and robustness, offering a promising avenue for advancing research in emotion cause analysis. The source code is available at https://***/zxgnlp/InstruDa-LLM. Copyright © 2025, The Authors. All rights reserved.

关键词： Natural language processing systems

Synthesizing adversarial negative responses for robust response ranking and evaluation

学校读者我要写书评

暂无评论

arXiv 2021年

作者： Gupta, Prakhar Tsvetkov, Yulia Bigham, Jeffrey P. Language Technologies Institute Carnegie Mellon University United States Paul G. Allen School of Computer Science and Engineering University of Washington United States Human-Computer Interaction Institute Carnegie Mellon University United States

Open-domain neural dialogue models have achieved high performance in response ranking and evaluation tasks. These tasks are formulated as a binary classification of responses given in a dialogue context, and models generally learn to make predictions based on context-response content similarity. However, over-reliance on content similarity makes the models less sensitive to the presence of inconsistencies, incorrect time expressions and other factors important for response appropriateness and coherence. We propose approaches for automatically creating adversarial negative training data to help ranking and evaluation models learn features beyond content similarity. We propose mask-and-fill and keyword-guided approaches that generate negative examples for training more robust dialogue systems. These generated adversarial responses have high content similarity with the contexts but are either incoherent, inappropriate or not fluent. Our approaches are fully data-driven and can be easily incorporated in existing models and datasets. Experiments on classification, ranking and evaluation tasks across multiple datasets demonstrate that our approaches outperform strong baselines in providing informative negative examples for training dialogue systems. © 2021, CC BY.

关键词： Speech processing

Investigating the interaction Experience with Augmented Reality Based Writing Tools 21st

学校读者我要写书评

暂无评论

Investigating the Interaction Experience with Augmented Real...

21st International Conference on human-computer interaction, HCI International 2019

作者： Zheng, Wei Yi, Xin Shi, Yuanchun Pervasive Human-Computer Interaction Group Department of Computer Science and Technology Tsinghua University Beijing100084 China

ISBN: (纸本)9783030235277

The contents of this paper include the design methodology of perceptual computing products, the innovative design of the AR writing and its technical feasibility, the writing interactive experience test of different hardware platforms, etc. It has certain reference value for the research work of paperless writing. © Springer Nature Switzerland AG 2019.

关键词： Augmented reality