检索结果-内蒙古大学图书馆

Multimodal prototypical networks with Co-metric fusion for few-shot hyperspectral image classification

Neurocomputing 2025年 648卷

作者： Yuhang Li Jinrong He Hanchi Liu Yurong Zhang Zhaokui Li College of Mathematics and Computer Science Yan'an University Yan’an 716000 China Guangxi Key Lab of Human-machine Interaction and Intelligent Decision Nanning Normal University Nanning 530100 China School of Computer Shenyang Aerospace University Shenyang 110136 China

In the field of Hyperspectral image (HSI) classification, prototype-based network methods have achieved significant research progress. These methods utilize pixel-level information from images to construct central prototypes for each class, providing effective solutions for few-shot learning. However, traditional prototype networks have some inherent flaws; they primarily rely on a single image modality and fail to fully leverage the potential complementarity between different modalities, using only a single modality to generate class prototypes, which limits the model's performance in representing class prototypes and enhancing discriminative capabilities. And subtle inter-class differences are also a challenging task in cross-domain scenarios. To overcome these challenges, this study proposes an innovative Multimodal Prototypical Networks with Co-metric Fusion (MPCF). By integrating prototype information from both image and text modalities, MPCF significantly enhances the performance of few-shot learning. The method not only captures the spectral and spatial features of images to construct image prototypes but also extracts textual features from category descriptions to generate text prototypes. Furthermore, by integrating contrastive learning strategies with the Co-metric fusion mechanism, the method effectively harnesses the information from different modalities. This integration allows for the capture of category information across multiple dimensions, significantly boosting the model's discriminative power among various classes and enhancing its capacity to address few-shot learning scenarios. Experiments conducted on several public benchmark HSI datasets (Indian Pines-84.06 %, Houston-80.41 %, Salinas-92.63 %) demonstrate that MPCF exhibits excellent performance under few-shot and cross-domain conditions, achieving higher classification accuracy and stronger robustness compared to state-of-the-art methods. The related code will be made publicly available at t

关键词：

来源：评论

学校读者我要写书评

暂无评论

Theory of Mind Abilities Predict Robot's Gaze Effects on Object Preference

引用

IEEE Transactions on Affective Computing 2025年

作者： Manzi, Federico Ishikawa, Mitsuhiko Dio, Cinzia Di Itakura, Shoji Kanda, Takayuki Ishiguro, Hiroshi Massaro, Davide Marchetti, Antonella Università Cattolica del Sacro Cuore Research Unit on Theory of Mind Department of Psychology Milan Italy Università Cattolica del Sacro Cuore Research Unit in Psychology and Robotics in the Lifespan Department of Psychology Milan Italy IRCCS Fondazione Don Carlo Gnocchi Milan Italy Hitotsubashi University Hitotsubashi Institute for Advanced Study Japan Ritsumeikan University Kyoto Japan Kyoto University Department of Computer Science Human-Robot Interaction Laboratory Kyoto Japan IRC'HIL Keihana Science City Advanced Telecommunications Research Institute International Kyoto Japan Osaka University Department of Intelligent Systems Toyonaka Japan

This study investigated the differences between human and robot gaze in influencing preference formation, and examined the role of Theory of Mind (ToM) abilities in this process. human eye gaze is one of the most important sources of information for social interaction and research has demonstrated its effectiveness in influencing people's preference. With increasing technological development, we will interact with robots that can exhibit gaze behavior and influence people's preference. It is unclear whether there are any differences between humans and robots in this process. The present study aimed to analyze the role of the gaze of a robot and a human in influencing the ascription of a preference to the gazer and the participants' preference. Furthermore, we examined the role of ToM abilities in preference formation. The results showed that the gaze has a greater effect on the gazer preference compared to participants' preference regardless of the agent (human or robot). In addition, ToM abilities predict both gazer and individual preferences in the robot's condition only even though different socio-cognitive mechanisms are involved. The study suggests that adults are cognitively able to process the gaze of a robot similar to a human, recognizing the underlying mental state. However, only for the robot, different cognitive mechanisms are involved in the gazer (i.e., perspective taking) and participants' preference formation (i.e., advanced ToM). © 2010-2012 IEEE.

关键词： Social robots

来源：评论

学校读者我要写书评

暂无评论

Prediction of Budd-Chiari syndrome based on attention mechanisms of high-risk factors in multi-hop graph learning

引用

science CHINA Information sciences 2025年第7期68卷 1-2页

作者： Lei WANG Shengli LI Xiaorui SU Zhengwei LI Mengmeng WEI Bowei ZHAO Maoheng ZU Qingqiao ZHANG Zhuhong YOU School of Computer Science and Technology China University of Mining and Technology Xuzhou 221116 China Guangxi Key Lab of Human-Machine Interaction and Intelligent Decision Guangxi Academy of Sciences Nanning 530007 China Clinical Research Institute The Affiliated Hospital of Xuzhou Medical University Xuzhou 221006 China University of Chinese Academy of Sciences Beijing 100049 China Xinjiang Technical Institute of Physics and Chemistry Chinese Academy of Sciences Urumqi 830011 China Department of Interventional Radiology The Affiliated Hospital of Xuzhou Medical University Xuzhou 221006 China

来源：评论

学校读者我要写书评

暂无评论

Natural human Skin‑Inspired Wearable and Breathable Nanofiber‑based Sensors with Excellent Thermal Management Functionality

引用

Advanced Fiber Materials 2024年第6期6卷 1955-1968页

作者： Peng Wang Xiaodan Li Guifen Sun Guoqing Wang Qing Han Chuizhou Meng Zhonghe Wei Yang Li School of Mechanical Engineering University of JinanJinan 250022China School of Information and Control Engineering China University of Mining and TechnologyXuzhou 221116China State Key Laboratory for Reliability and Intelligence of Electrical Equipment Engineering Research Center of Ministry of Education for Intelligent Rehabilitation Device and Detection TechnologyHebei Key Laboratory of Smart Sensing and Human‑Robot InteractionSchool of Mechanical EngineeringHebei University of TechnologyTianjin 300401China Shandong Provincial Key Laboratory of Network‑Based Intelligent Computing School of Information Science and EngineeringUniversity of JinanJinan 250022China Network Information Center Department of Computer ScienceQilu University of Technology(Shandong Academy of Sciences)Jinan 250353China School of Integrated Circuits Shandong UniversityJinan 250101China

Wearable sensors have been rapidly developed for application in various human monitoring ***,the wearing comfort and thermal properties of these devices have been largely ignored,and these characteristics urgently need to be ***,we develop a wearable and breathable nanofiber-based sensor with excellent thermal management functionality based on passive heat preservation and active Joule heating *** multifunctional device consists of a micropatterned carbon nanotube(CNT)/thermoplastic polyurethane(TPU)nanofiber electrode,a microporous ionic aerogel electrolyte and a microstructured Ag/TPU nanofiber *** to the presence of a supercapacitive sensing mechanism and the appli-cation of microstructuration,the sensor shows excellent sensing performance,with a sensitivity of 24.62 ***,due to the overall porous structure and hydrophobicity of TPU,the sensor shows good breathability(62 mm/s)and water repellency,with a water contact angle of 151.2°.In addition,effective passive heat preservation is achieved by combining CNTs with high solar absorption rates(85%)as the top layer facing the outside,aerogel with a low thermal conductivity(0.063 W m-1 k-1)as the middle layer for thermal insulation,and Ag with a high infrared reflectance rate as the bottom layer facing the *** warming,this material yields a higher temperature than ***,the active Joule heat-ing effect is realized by applying current through the bottom resistive electrode,which can quickly increase the temperature to supply controlled warming on *** proposed wearable and breathable sensor with tunable thermal properties is promising for monitoring and heat therapy applications in cold environments.

关键词： Wearable sensor Breathable Personal thermal management Electrospun nanofibers Joule heating

来源：评论

学校读者我要写书评

暂无评论

Explaining the Black-box Smoothly - A Counterfactual Approach

arXiv

引用

arXiv 2021年

作者： Singla, Sumedha Eslami, Motahhare Pollack, Brian Wallace, Stephen Batmanghelich, Kayhan Computer Science Department The University of Pittsburgh PittsburghPA15206 United States School of Computer Science Human-Computer Interaction Institute Carnegie Mellon University United States Department of Biomedical Informatics The University of Pittsburgh PittsburghPA15206 United States University of Pittsburgh Medical School PittsburghPA15206 United States

We propose a BlackBox Counterfactual Explainer, designed to explain image classification models for medical applications. Classical approaches (e.g., saliency maps) that assess feature importance do not explain how imaging features in important anatomical regions are relevant to the classification decision. Such reasoning is crucial for transparent decision-making in healthcare applications. Our framework explains the decision for a target class by gradually exaggerating the semantic effect of the class in a query image. We adopted a Generative Adversarial Network (GAN) to generate a progressive set of perturbations to a query image, such that the classification decision changes from its original class to its negation. Our proposed loss function preserves essential details (e.g., support devices) in the generated images. We used counterfactual explanations from our framework to audit a classifier trained on a chest x-ray dataset with multiple labels. Clinical evaluation of model explanations is a challenging task. We proposed clinically-relevant quantitative metrics such as cardiothoracic ratio and the score of a healthy costophrenic recess to evaluate our explanations. We used these metrics to quantify the counterfactual changes between the populations with negative and positive decisions for a diagnosis by the given classifier. We conducted a human-grounded experiment with diagnostic radiology residents to compare different styles of explanations (no explanation, saliency map, cycleGAN explanation, and our counterfactual explanation) by evaluating different aspects of explanations: (1) understandability, (2) classifier's decision justification, (3) visual quality, (d) identity preservation, and (5) overall helpfulness of an explanation to the users. Our results show that our counterfactual explanation was the only explanation method that significantly improved the users' understanding of the classifier's decision compared to the no-explanation baseline. Our metric

关键词： Medical applications

来源：评论

学校读者我要写书评

暂无评论

Mixed reality based respiratory liver tumor puncture navigation

引用

Computational Visual Media 2019年第4期5卷 363-374页

作者： Ruotong Li Weixin Si Xiangyun Liao Qiong Wang Reinhard Klein Pheng-Ann Heng Institute of Computer Science II University of Bonn53115 BonnGermany Shenzhen Key Laboratory of Virtual Reality and Human Interaction Technology Shenzhen Institutes of Advanced TechnologyChinese Academy of SciencesChina Department of Computer Science and Engineering Chinese University of Hong KongHong KongChina

This paper presents a novel mixed reality based navigation system for accurate respiratory liver tumor punctures in radiofrequency ablation(RFA).Our system contains an optical see-through head-mounted display device(OST-HMD),Microsoft Holo Lens for perfectly overlaying the virtual information on the patient,and a optical tracking system NDI Polaris for calibrating the surgical utilities in the surgical *** with traditional navigation method with CT,our system aligns the virtual guidance information and real patient and real-timely updates the view of virtual guidance via a position tracking *** addition,to alleviate the difficulty during needle placement induced by respiratory motion,we reconstruct the patientspecific respiratory liver motion through statistical motion model to assist doctors precisely puncture liver *** proposed system has been experimentally validated on vivo pigs with an accurate real-time registration approximately 5-mm mean FRE and TRE,which has the potential to be applied in clinical RFA guidance.

关键词： mixed reality human computer interaction statistical motion model

来源：评论

学校读者我要写书评

暂无评论

Towards expert gaze modeling and recognition of a user’s attention in realtime

引用

Procedia computer science 2020年 176卷 2020-2029页

作者： Nora Castner Lea Geßler David Geisler Fabian Hüttig Enkelejda Kasneci Human-Computer Interaction University of Tübingen Germany Institute of Computer Science University of Tübingen Germany Department of Prosthodontics University Hospital Tübingen Germany

One of the appealing areas of expertise research is devoted to measuring the effectiveness of training programs for novices. With recent progress in eye tracking, gaze-based interaction systems recognize a user’s attention and can direct it accordingly. Moreover, dynamic visualization of an expert gaze model facilitates novice training by guiding the gaze to relevant areas. In addition, the system should be aware of realtime attention to remove an overlay that could occlude relevant information. We use an implementation of subtle gaze direction (SGD) and the simplified scanpath of a dentist to train naive participants in finding anomalies in dental radiographs. We were able to effectively direct user gaze to relevant image features without occluding the area when attention was recognized. Additionally, participants reported that the intervention was helpful for image inspection. The results of the model intervention show minimal improvements in anomaly detection, which is expected of naive subjects. We advocate that the system has the potential to be highly effective for advanced students and trainees with a certain foundation of conceptual knowledge.

关键词： Eye Tracking Gaze-based interaction Attention Guiding Expertise Learning

来源：评论

学校读者我要写书评

暂无评论

MLM-Net: Streamlined Multi-Lane Detection Network with Spatio-temporal Memory for Video Instance Lane Detection

MLM-Net: Streamlined Multi-Lane Detection Network with Spati...

引用

International Conference on Intelligent Transportation

作者： Xiaoqin Wang Yunfei Yin Faliang Huang Xianjian Bao School of Mechanical and Vehicle Engineering Chongqing University Chongqing P. R. China School of Computer Science Chongqing University Chongqing P. R. China Guangxi Key Lab of Human-machine Interaction and Intelligent Decision Nanning Normal University Nanning P. R. China School of Maharishi University of Management Fairfield IOWA USA

Lane detection is a crucial task in autonomous driving as it helps vehicles maintain stable and efficient driving in complex traffic environments. Image-based and video-based lane detection are two common methods, with video-based lane detection being more effective in handling complex scenarios such as lane occlusion and wear. However, most existing video-based lane detection methods suffer from information redundancy, where the same key frames of the same lane are repeatedly calculated during the detection of multiple lanes. Additionally, the spatio-temporal sequence information of video-based lanes is not fully utilized. To address these challenges, MLM-Net is proposed as a streamlined multilane network that facilitates the sharing of spatiotemporal information. The Global Memory Feature (GMF) module is redesigned to mitigate information redundancy across multiple lanes, while the Local Spatio-Temporal Feature (LSTF) module is introduced to enhance the utilization of spatiotemporal consistency information. Additionally, the Enhanced Global Memory Feature (EGMF) module is introduced to extract enhanced features and handle challenging detection scenarios. Experimental results demonstrate that our method achieves state-of-the-art performance for video instance lane detection on the VIL-100 dataset.

关键词：

来源：评论

学校读者我要写书评

暂无评论

An Adaptive Bionic Sensor: Enhancing Ankle Joint Tracking with High Sensitivity and Superior Cushioning Performance

SSRN

引用

SSRN 2024年

作者： Jin, Jianqiao Zhang, Chen Zhao, Jianyuan Yu, Minghan Lei, Ming Jin, Chun Yin, Rui Zhao, Weiwei Sauvage Laboratory for Smart Materials The School of Integrated Circuit Harbin Institute of Technology Shenzhen518055 China Shenzhen Key Laboratory of Flexible Printed Electronics Technology Harbin Institute of Technology Shenzhen518055 China State Key Laboratory of Advanced Welding & Joining Harbin Institute of Technology Harbin150001 China Human-Computer Interaction Design Lab School of System Design and Intelligent Manufacturing Southern University of Science and Technology Shenzhen518055 China

Flexible sensors are renowned for their rapid responsiveness, high flexibility, and outstanding mechanical properties, making them ideal for applications in wearable devices, sports and health monitoring, and human-machine interfaces. To enhance the sensing performance of these flexible sensors, researchers have drawn inspiration from nature, creating various bionic microstructures. However, these structures often manifest in the macroscopic form of thin films, which do little to improve impact resistance and joint protection. In response, this work achieves a highly sensitive and impact-resistant pressure sensor by integrating bionic principles at both micro and macro levels. Specifically, at the micro level, a muscle-like hydrogel system consisting of MXene nanosheets incorporated into the double network of polyvinyl alcohol and sodium alginate matrix is selected. At the macro level, the bionic prototypes of mimosa leaves and durian spikes with good energy absorption structure, together with octopus’ sucker with good adsorption capacity are selected, and the synergistic construction of the three structures is realized through 3D printing methods. The obtained sensor has an appropriate response range, sensitivity and stability. More importantly, the displacement deformation of the hydrogel can be reduced by 91.22%, while its adhesion strength can be increased by 57.5% compared to the unstructured hydrogel. As a proof-of-concept, the proposed bionic flexible sensor can be used to monitor the motion status of the human ankle joint in real-time, thereby assisting users in making real-time judgments on gait health. © 2024, The Authors. All rights reserved.

关键词： Sodium alginate

来源：评论

学校读者我要写书评

暂无评论

Gesture interaction in virtual reality

引用

Virtual Reality & Intelligent Hardware 2019年第1期1卷 84-112页

作者： Yang LI Jin HUANG Feng TIAN Hong-An WANG Guo-Zhong DAI Beijing Key Laboratory of Human-Computer Interaction Institute of SoftwareChinese Academy of SciencesBeijing 100190China State Key Laboratory of Computer Science Chinese Academy of SciencesBeijing 100190China

With the development of virtual reality(VR)and human-computer interaction technology,how to use natural and efficient interaction methods in the virtual environment has become a hot topic of *** is one of the most important communication methods of human beings,which can effectively express users'*** the past few decades,gesture-based interaction has made significant *** article focuses on the gesture interaction technology and discusses the definition and classification of gestures,input devices for gesture interaction,and gesture interaction recognition *** application of gesture interaction technology in virtual reality is studied,the existing problems in the current gesture interaction are summarized,and the future development is prospected.

关键词： Virtual reality Gesture interaction Gesture recognition

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：