检索结果-内蒙古大学图书馆

One Patient’s Annotation is Another One’s Initialization: Towards Zero-Shot Surgical Video Segmentation with Cross-Patient Initialization

学校读者我要写书评

暂无评论

arXiv 2025年

作者： Mousavi, Seyed Amir Ozbulak, Utku Tozzi, Francesca Rashidian, Nikdokht Willaert, Wouter Vankerschaver, Joris De Neve, Wesley Center for Biosystems and Biotech Data Science Ghent University Global Campus Incheon Korea Republic of IDLab ELIS Ghent University Ghent Belgium Department of GI Surgery Ghent University Hospital Ghent Belgium Department of Human Structure and Repair Ghent University Ghent Belgium Department of HPB Surgery & Liver Transplantation Ghent University Hospital Ghent Belgium Department of Applied Mathematics Computer Science and Statistics Ghent University Ghent Belgium

Video object segmentation is an emerging technology that is well-suited for real-time surgical video segmentation, offering valuable clinical assistance in the operating room by ensuring consistent frame tracking. However, its adoption is limited by the need for manual intervention to select the tracked object, making it impractical in surgical settings. In this work, we tackle this challenge with an innovative solution: using previously annotated frames from other patients as the tracking frames. We find that this unconventional approach can match or even surpass the performance of using patients’ own tracking frames, enabling more autonomous and efficient AI-assisted surgical workflows. Furthermore, we analyze the benefits and limitations of this approach, highlighting its potential to enhance segmentation accuracy while reducing the need for manual input. Our findings provide insights into key factors influencing performance, offering a foundation for future research on optimizing cross-patient frame selection for real-time surgical video analysis. Copyright © 2025, The Authors. All rights reserved.

关键词： Image segmentation

EEG-Eye Movements Cross-Modal Decision Confidence Measurement with Generative Adversarial Networks

学校读者我要写书评

暂无评论

EEG-Eye Movements Cross-Modal Decision Confidence Measuremen...

International IEEE/EMBS Conference on Neural Engineering, CNE

作者： Cheng Fei Rui Li Li-Ming Zhao Wei-Long Zheng Bao-Liang Lu Department of Computer Science and Engineering Center for Brain-Like Computing and Machine Intelligence Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering and Brain Science and Technology Research Center Shanghai Jiao Tong University Shanghai People's Republic of China RuiJin-Mihoyo Laboratory Clinical Neuroscience Center RuiJin Hospital Shanghai Jiao Tong University School of Medicine Shanghai People's Republic of China

Decision confidence is an individual's feeling of correctness or optimization when making a decision. Various physiological signals, including electroencephalography (EEG) and eye movements have been studied extensively in measuring levels of decision confidence in humans. While multimodal fusion generally performs better than single-modal approaches, it requires data from different modalities at a greater cost. In particular, collection of EEG data is more complicated and time consuming while eye movement signals are much easier to acquire. To tackle this problem, we propose a cross-modal method based on generative adversarial learning. In our method, the intrinsic relationship between eye movement and EEG features in a high-level feature space can be learned in the training phase, and then we can obtain multimodal information during the test phase when only eye movements are available as inputs. Experimental results on the SEED-VPDC dataset demonstrate that our proposed method outperforms single-modal methods trained and tested only on eye movement signals with an improvement of approximately 5.43% in accuracy, and maintains competitive performance in comparison with multimodal methods. Our cross-modal approach requires only eye movements as inputs and reduces reliance on EEG data, making the decision confidence measurement more applicable and practicable.

关键词： Training Costs Neural engineering Particle measurements Generative adversarial networks Electroencephalography Adversarial machine learning

A human-human Physical interaction System for Training Handwriting

学校读者我要写书评

暂无评论

A Human-Human Physical Interaction System for Training Handw...

IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob)

作者： S. Buscaglione A. Noccaro C. Provenzale C. Bonsignori E. Ivanova L. Sparaci F. Taffoni E. Burdet D. Formica NEXT: Neurophysiology and Neuroengineering of Human-Technology Interaction Research Unit Università Campus Bio-Medico di Roma Italy Neurorobotics Lab Newcastle University Newcastle Upon Tyne UK Advanced Robotics and Human-Centred Technologies-CREO Laboratory Università Campus Bio-Medico di Roma Italy Department of Bioengineering Imperial College of Science Technology and Medicine UK School of Electric Engineering and Computer Science Queen Mary University of London UK Institute of Cognitive Sciences and Technologies (ISTC) National Research Council of Italy (CNR) Italy

ISBN: (数字)9798350386523

ISBN: (纸本)9798350386530

Handwriting training in childhood is known to influence academic success, foster self-esteem, and contribute to overall development. Previous studies underscored the positive impact of haptic feedback on handwriting learning using one-way communication systems that provided the trainee with haptic feedback based on pre-recorded trainer's movements. In this study, we propose a system involving bidirectional physical coupling (haptic communication) between a trainee and a trainer to exploit the advantages of haptic communication for motor task improvement, proved in tracking tasks. The system, composed of an interactive display and a coupling spring, was tested in a handwriting task performed by a dyad of healthy adults with different cursive handwriting backgrounds. The participants' performance demonstrated the feasibility of using this system for handwriting, opening the way for further studies to assess its benefits in handwriting improvement and learning.

关键词： Training Couplings Tracking Communication systems Biomechatronics Motors Haptic interfaces Springs Robots

END-TO-END LYRICS RECOGNITION WITH SELF-SUPERVISED LEARNING

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Zhang, Xiangyu Li, Shuyue Stella He, Zhanhong Togneri, Roberto Garcia, Leibny Paola Center for Language and Speech Processing Johns Hopkins University United States Human Language Technology Center of Excellence Johns Hopkins University United States Department of Computer Science University of Western Australia Australia

Lyrics recognition is an important task in music processing. Despite traditional algorithms such as the hybrid HMM-TDNN model achieving good performance, studies on applying end-to-end models and self-supervised learning (SSL) are limited. In this paper, we first establish an end-to-end baseline for lyrics recognition and then explore the performance of SSL models on lyrics recognition task. We evaluate a variety of upstream SSL models with different training methods (masked reconstruction, masked prediction, autoregressive reconstruction, and contrastive learning). Our end-to-end self-supervised models, evaluated on the DAMP music dataset, outperform the previous state-of-the-art (SOTA) system by 5.23% for the dev set and 2.4% for the test set even without a language model trained by a large corpus. Moreover, we investigate the effect of background music on the performance of self-supervised learning models and conclude that the SSL models cannot extract features efficiently in the presence of background music. Finally, we study the out-of-domain generalization ability of the SSL features considering that those models were not trained on music datasets. Copyright © 2022, The Authors. All rights reserved.

关键词： Supervised learning

From EEG to Eye Movements: Cross-modal Emotion Recognition Using Constrained Adversarial Network with Dual Attention

学校读者我要写书评

暂无评论

IEEE Transactions on Affective Computing 2024年

作者： Wang, Yiting Liu, Jia-Wen Lu, Bao-Liang Zheng, Wei-Long Karolinska Institutet Department of Clinical Neuroscience Stockholm171 77 Sweden Shanghai Jiao Tong University China Shanghai Jiao Tong University Center for Brain-Like Computing and Machine Intelligence Department of Computer Science and Engineering Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive Engineering Shanghai200240 China Shanghai Jiao Tong University School of Medicine RuiJin-Mihoyo Laboratory Clinical Neuroscience Center RuiJin Hospital Shanghai200020 China Shanghai Emotionhelper Technology Co. Ltd. Shanghai China

Emotion recognition is a fundamental part of affective computing, obtaining performance gain from multimodal methods. Electroencephalography (EEG) and eye movements are extensively used as they contain complementary information. However, the inconvenient acquisition of EEG is hindering the extensive adoption of multimodal emotion recognition in daily applications while eye movements are more convenient to collect but with lower performance. To tackle this issue, we propose a Constrained Adversarial Network with Dual Attention (CANDA), exploiting the complementary information from multiple modalities during training to improve the test-time performance of single easily acquired modality, i.e., transferring knowledge from a stronger modality to a weaker modality. During training, a common joint space is learned to diminish the distribution discrepancy among different modalities and incorporate the multimodal representations. During test, single modality is converted to the common space achieving comparable performance to multiple modalities. Extensive experiments demonstrate that our model achieves the state-of-the-art performance for cross-modal emotion recognition. Specifically, the mean accuracy increases around 15% on SEED, 15% on SEED-IV, and 2% on SEED-V compared to the latest baseline for emotion recognition. Visualization of features in the joint space illustrates that the distribution of different modalities aligns together with the discriminative ability regarding various emotions. © 2010-2012 IEEE.

关键词： Electroencephalography

Current understanding of osteoarthritis pathogenesis and relevant new approaches

学校读者我要写书评

暂无评论

Bone Research 2022年第4期10卷 627-643页

作者： Liping Tong Huan Yu Xingyun Huang Jie Shen Guozhi Xiao Lin Chen Huaiyu Wang Lianping Xing Di Chen Research Center for Computer-aided Drug Discovery Shenzhen Institute of Advanced TechnologyChinese Academy of SciencesShenzhen 518005China Faculty of Pharmaceutical Sciences Shenzhen Institute of Advanced TechnologyChinese Academy of SciencesShenzhen 518055China Department of Orthopedic Surgery School of MedicineWashington University in St.LouisSt.LouisMO 63110USA School of Medicine Southern University of Science and TechnologyShenzhen 518055China Department of Wound Repair and Rehabilitation State Key Laboratory of TraumaBurns and Combined InjuryDaping HospitalArmy Medical UniversityChongqing 400042China Research Center for Human Tissues and Organs Degeneration Shenzhen Institute of Advanced TechnologyChinese Academy of SciencesShenzhen 518055China Department of Pathology and Laboratory of Medicine Center for Musculoskeletal ResearchUniversity of Rochester Medical CenterRochesterNY 14642USA

Osteoarthritis(OA)is the most common degenerative joint disease that causes painful swelling and permanent damage to the joints in the *** molecular mechanisms of OA are currently *** is a heterogeneous disease that affects the entire joint,and multiple tissues are altered during OA *** better understand the pathological mechanisms of OA,new approaches,methods,and techniques need to be used to understand OA *** this review,we first focus on the epigenetic regulation of OA,with a particular focus on DNA methylation,histone modification,and microRNA regulation,followed by a summary of several key mediators in OA-associated *** then introduce several innovative techniques that have been and will continue to be used in the fields of OA and OA-associated pain,such as CRISPR,scRNA sequencing,and lineage ***,we discuss the timely updates concerning cell death regulation in OA pathology,including pyroptosis,ferroptosis,and autophagy,as well as their individual roles in OA and potential molecular targets in treating ***,our review highlights new directions on the role of the synovial lymphatic system in *** improved understanding of OA pathogenesis will aid in the development of more specific and effective therapeutic interventions for OA.

关键词： pathogenesis swelling concerning

Gait Events Prediction using Hybrid CNN-RNN-based Deep Learning models through a Single Waist-worn Wearable Sensor

学校读者我要写书评

暂无评论

arXiv 2022年

作者： Arshad, Muhammad Zeeshan Jamsrandorj, Ankhzaya Kim, Jinwook Mun, Kyung-Ryoul The Center for Artificial Intelligence KIST Seoul Korea Republic of The Department of Human Computer Interface & Robotics Engineering University of Science & Technology Daejon Korea Republic of KHU-KIST Department of Converging Science and Technology KHU Seoul Korea Republic of

Elderly gait is a source of rich information about their physical and mental health condition. As an alternative to the multiple sensors on the lower body parts, a single sensor on the pelvis has a positional advantage and an abundance of information acquirable. This study aimed to explore a way of improving the accuracy of gait event detection in the elderly using a single sensor on the waist and deep learning models. Data was gathered from elderly subjects equipped with three IMU sensors while they walked. The input was taken only from the waist sensor was used to train 16 deep-learning models including CNN, RNN, and CNN-RNN hybrid with or without the Bidirectional and Attention mechanism. The groundtruth was extracted from foot IMU sensors. Fairly high accuracy of 99.73% and 93.89% was achieved by the CNN-BiGRU-Att model at the tolerance window of ±6TS (±6ms) and ±1TS (±1ms) respectively. Advancing from the previous studies exploring gait event detection, the model showed a great improvement in terms of its prediction error having an MAE of 6.239ms and 5.24ms for HS and TO events respectively at the tolerance window of ±1TS. The results showed that the use of CNN-RNN hybrid models with Attention and Bidirectional mechanisms is promising for accurate gait event detection using a single waist sensor. The study can contribute to reducing the burden of gait detection and increase its applicability in future wearable devices that can be used for remote health monitoring (RHM) or diagnosis based thereon. Copyright © 2022, The Authors. All rights reserved.

关键词： Gait analysis

Polarized Online Discourse on Abortion: Frames and Hostile Expressions among Liberals and Conservatives

学校读者我要写书评

暂无评论

arXiv 2023年

作者： Rao, Ashwin Chang, Rong-Ching Zhong, Qiankun Lerman, Kristina Wojcieszak, Magdalena University of Southern California Information Sciences Institute Marina del ReyCA United States Department of Computer Science University of California Davis United States Max Planck Institute for Human Development Germany Department of Communication University of California Davis United States Center for Excellence in Social Science University of Warsaw Poland

Abortion has been one of the most divisive issues in the United States. Yet, missing is comprehensive longitudinal evidence on how political divides on abortion are reflected in public discourse over time, on a national scale, and in response to key events before and after the overturn of Roe v Wade. We analyze a corpus of over 3.5M tweets related to abortion over the span of one year (January 2022 to January 2023) from over 1.1M users. We estimate users’ ideology and rely on state-of-the-art transformer-based classifiers to identify expressions of hostility and extract five prominent frames surrounding abortion. We use those data to examine (a) how prevalent were expressions of hostility (i.e., anger, toxic speech, insults, obscenities, and hate speech), (b) what frames liberals and conservatives used to articulate their positions on abortion, and (c) the prevalence of hostile expressions in liberals and conservative discussions of these frames. We show that liberals and conservatives largely mirrored each other’s use of hostile expressions: as liberals used more hostile rhetoric, so did conservatives, especially in response to key events. In addition, the two groups used distinct frames and discussed them in vastly distinct contexts, suggesting that liberals and conservatives have differing perspectives on abortion. Lastly, frames favored by one side provoked hostile reactions from the other: liberals use more hostile expressions when addressing religion, fetal personhood, and exceptions to abortion bans, whereas conservatives use more hostile language when addressing bodily autonomy and women’s health. This signals disrespect and derogation, which may further preclude understanding and exacerbate polarization. © 2023, CC BY.

关键词： Polarization

An Empirical Examination of Balancing Strategy for Counterfactual Estimation on Time Series

学校读者我要写书评

暂无评论

arXiv 2024年

作者： Huang, Qiang Meng, Chuizheng Cao, Defu Huang, Biwei Chang, Yi Liu, Yan School of Artificial Intelligence Jilin University Jilin Changchun China International Center of Future Science Jilin University Jilin Changchun China Department of Computer Science University of Southern California California Los Angeles United States Halicioğlu Data Science Institute University of California San Diego San DiegoCA United States Engineering Research Center of Knowledge-Driven Human-Machine Intelligence MOE Jilin Changchun China

Counterfactual estimation from observations represents a critical endeavor in numerous application fields, such as healthcare and finance, with the primary challenge being the mitigation of treatment bias. The balancing strategy aimed at reducing covariate disparities between different treatment groups serves as a universal solution. However, when it comes to the time series data, the effectiveness of balancing strategies remains an open question, with a thorough analysis of the robustness and applicability of balancing strategies still lacking. This paper revisits counterfactual estimation in the temporal setting and provides a brief overview of recent advancements in balancing strategies. More importantly, we conduct a critical empirical examination for the effectiveness of the balancing strategies within the realm of temporal counterfactual estimation in various settings on multiple datasets. Our findings could be of significant interest to researchers and practitioners and call for a reexamination of the balancing strategy in time series settings. Copyright © 2024, The Authors. All rights reserved.

关键词： Time series analysis