检索结果-内蒙古大学图书馆

Towards Depth-continuous Scene Representation with Displacement Field for Robust Light Field Depth Estimation

IEEE Transactions on Multimedia 2025年

作者： Chen, Rongshan Sheng, Hao Yang, Da Cong, Ruixuan Cui, Zhenglong Wang, Sizhe Wang, Tun Zhao, Mingyuan Beihang University State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and Engineering Beijing100191 China Beihang University Key Laboratory of Data Science and Intelligent Computing International Innovation Institute 166 Shuanghongqiao Street Pingyao Town Yuhang District Hangzhou31 1115 China Macao Polytechnic University Faculty of Applied Sciences Macao999078 China

The light field (LF) captures both the spatial and angular information of scenes, enabling accurate depth estimation. However, previous deep learning methods typically model surface depth only while ignoring the continuous nature of depth in 3D scenes. In this paper, we use the displacement field (DF) to describe this continuous property, and propose a novel depth-continuous scene representation for robust LF depth estimation. Experiments demonstrate that our representation enables the network to generate highly detailed depth maps with fewer parameters and faster speeds. Specifically, inspired by the signed distance field in 3D object descriptions, we aim to exploit the intrinsic depth-continuous property of 3D scenes via DF and define a novel depth-continuous scene representation. Then, we introduce a simple, yet general, learning framework for depth-continuous scene embedding, and the proposed network, DepthDF, achieves state-of-the-art performance on both synthetic and real-world LF datasets, ranking 1st on the HCI 4D light field benchmark. Furthermore, previous LF depth estimation methods can also be seamlessly integrated into this framework. Finally, we extend this framework beyond LF depth estimation to various tasks, including multiview stereo depth inference, LF superresolution, and LF salient object detection. Our experiments demonstrate an improved performance when continuous scene representation is applied, suggesting that our framework can potentially provide insights for more fields. © 1999-2012 IEEE.

关键词： Stereo image processing

来源：评论

学校读者我要写书评

暂无评论

key Clues Guided Video Character Social Relationship Recognition Enhanced by LLM

Key Clues Guided Video Character Social Relationship Recogni...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Wenlong Dong Qing Zhu Qirong Mao School of Computer Science and Communication Engineering Jiangsu University China Jiangsu Engineering Research Center of Big Data Ubiquitous Perception and Intelligent Agriculture Applications China Provincial Key Laboratory of Computational Intelligence and New Technologies in Low-Altitude Digital Agriculture Zhenjiang China

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Video Character Social Relationship Recognition (VCSRR) requires a comprehensive consideration about spatio-temporal and multi-modal clues in videos. Most existing methods mainly focus on integrating multi-modal clues and modeling interactions among characters. However, they fail to discover key clues in the complex video data or fully understand the clues related to social relationships. In this article, we propose a novel Large Language Model Enhanced key Clues Selection (LE-KCS) framework to address the aforementioned issues. The core of LE-KCS is to mine multi-scale key clues from the perspectives of time, space and multi-modality, then transfer the knowledge about social relationships of the Large Language Model to VCSRR for understanding the selected clues. We evaluated LE-KCS on the MovieGraphs dataset and the experimental results indicate that our proposed LE-KCS achieves state-of-the-art performance.

关键词： Accuracy Large language models Speech recognition Signal processing Acoustics Character recognition Speech processing

来源：评论

学校读者我要写书评

暂无评论

Plant Disease Phenotype Captioning Via Zero-Shot Learning with Semantic Correction Based on Llm

SSRN

引用

SSRN 2025年

作者： Xie, Yushan Dong, Xinyu Zhao, Kejun Sirishantha, G.M.A.D. Xiao, Yuanyuan Yu, Peijia Zhai, Changyuan Wang, Qi State Key Laboratory of Public Big Data College of Computer Science and Technology Guizhou University China Postgraduate Institute of Agriculture University of Peradeniya University of Peradeniya Peradeniya Sri Lanka Intelligent Equipment Research Center Beijing Academy of Agriculture and Forestry Sciences China

Agriculture is the foundation of global food security and quality of life, with staple crops such as rice, wheat, and maize meeting the dietary needs of the majority of the world's population. These crops are vulnerable to diseases that can cause severe yield losses;for instance, wheat rust disease results in annual losses exceeding \$2.9 billion. Accurate caption of the phenotypic characteristics of plant diseases play a crucial supportive role in diagnosis, which is essential to ensure food security. Existing methods in agriculture fail to adequately address the heterogeneity in visual phenotypes and disease descriptions, resulting in insufficient focus on disease characteristics. To mitigate this issue, we propose a zero-shot image captioning framework, namely PDPC. PDPC uses an extensive descriptive corpus, syntactic analysis, and optimization of semantic structures to significantly improve the quality and generalization of disease descriptions. Additionally, we have constructed a dataset comprising 20,943 image captions of plant disease characteristics for over 60 plant species and 300 diseases. Experimental results demonstrate that the PDPC framework outperforms existing models in accurately describing the characteristics of plant disease. The introduction of this innovative framework not only improves the accuracy of disease descriptions but also provides robust support for the intelligent diagnosis and management of plant diseases, paving the way for improved plant health and increased agricultural yields. Please click the following link to learn more about my paper: http://***/ © 2025, The Authors. All rights reserved.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

Meta-Transfer Learning Based Cross-Domain Gesture Recognition Using WiFi Channel State Information

引用

IEEE Transactions on Consumer Electronics 2025年

作者： Dai, Penglin Zhou, Junfei Ma, Jialong Zhang, Hao Wu, Xiao Southwest Jiaotong University School of Computing and Artificial Intelligence Chengdu611756 China Ministry of Education Engineering Research Center of Sustainable Urban Intelligent Transportation China Tangshan Institute of Southwest Jiaotong University Tangshan063000 China Chongqing University of Posts and Telecommunications College of Computer Science and Technology Key Laboratory of Data Engineering and Visual Computing Chongqing400065 China

Gesture recognition plays a crucial role in a wide range of consumer electronics applications, including human-computer interaction and virtual reality, by enabling the identification and interpretation of human gestures. In recent times, WiFi-based gesture recognition has garnered significant attention due to its privacy protection and unobtrusive nature. However, this approach heavily depends on neural network-based models and is notably influenced by environmental conditions, such as specific location and orientation. To address these environmental impacts, we propose a network framework that leverages transfer learning and meta-learning. The primary focus is on utilizing transfer learning to train a convolutional neural network (ResNet) for feature extraction, enabling the extraction of domain-independent features specifically related to gestures, rather than being influenced by environmental factors. Additionally, we employ the meta-learning algorithm MAML to train the fully connected network for gesture classification. Following training, a small set of samples can be utilized for rapid adaptation to diverse domains, maintaining high accuracy across different domains to achieve cross-domain gesture recognition. Our performance evaluation is based on the Widar 3.0 dataset, encompassing both in-domain and cross-domain scenarios. The simulation results demonstrate that our proposed algorithm surpasses Widar3.0 and WiGRUNT by approximately 7.9% and 1.12% in gesture recognition accuracy across all scenarios. © 2025 IEEE.

关键词： Wi-Fi

来源：评论

学校读者我要写书评

暂无评论

Diffusion-Based mmWave Radar Point Cloud Enhancement Driven by Range Images

arXiv

引用

arXiv 2025年

作者： Wu, Ruixin Li, Zihan Wang, Jin Xu, Xiangyu Yu, Huan Zheng, Zhi Huang, Kaixiang Lu, Guodong The State Key Laboratory of Fluid Power and Mechatronic Systems School of Mechanical Engineering Zhejiang University Hangzhou310058 China Zhejiang Key Laboratory of Industrial Big Data and Robot Intelligent Systems Zhejiang University Hangzhou310058 China Robotics Research Center of Yuyao City Ningbo315400 China State Key Laboratory of Robotics and Systems Department of Mechatronics Engineering Harbin Institute of Technology Harbin150001 China

Millimeter-wave (mmWave) radar has attracted significant attention in robotics and autonomous driving. However, despite the perception stability in harsh environments, the point cloud generated by mmWave radar is relatively sparse while containing significant noise, which limits its further development. Traditional mmWave radar enhancement approaches often struggle to leverage the effectiveness of diffusion models in super-resolution, largely due to the unnatural range-azimuth heatmap (RAH) or bird’s eye view (BEV) representation. To overcome this limitation, we propose a novel method that pioneers the application of fusing range images with image diffusion models, achieving accurate and dense mmWave radar point clouds that are similar to LiDAR. Benefitting from the projection that aligns with human observation, the range image representation of mmWave radar is close to natural images, allowing the knowledge from pre-trained image diffusion models to be effectively transferred, significantly improving the overall performance. Extensive evaluations on both public datasets and self-constructed datasets demonstrate that our approach provides substantial improvements, establishing a new state-of-the-art performance in generating truly three-dimensional LiDAR-like point clouds via mmWave radar. Copyright © 2025, The Authors. All rights reserved.

关键词： Radar imaging

来源：评论

学校读者我要写书评

暂无评论

A Fusion Tuning Method for Named Entity Recognition 12th

A Fusion Tuning Method for Named Entity Recognition

引用

12th CCF Conference on bigdata, bigdata 2024

作者： Wang, Jitian Chen, Yanping Zou, Anqi Qin, Yongbin Huang, Ruizhang Text Computing and Cognitive Intelligence Engineering Research Center of National Education Ministry Guizhou University Guiyang550025 China State Key Laboratory of Public Big Data Guizhou University Guiyang China College of Computer Science and Technology Guizhou University Guiyang550025 China

ISBN: (纸本)9789819610235

In named entity recognition, the main methods for constructing deep neural networks are fine-tuning and prompt tuning. Fine-tuning is a commonly used paradigm to optimize neural networks by using task-specific objective functions to make them more adapted to solve downstream tasks. In which pre-trained language models are used as external resources to provide contextual representations. Prompt tuning is a recent paradigm in which the downstream tasks are reformulated to look more like those solved during the original PLM training with the help of a textual prompt. It is effective to utilize potential knowledge of PLMs. In this paper, we propose the fusion approach, which sufficiently fuses the semantics obtained by extracting fine-tuning and prompt-tuning. In our approach, the model makes decisions based on the information obtained from the reconstructive fusion of the fine-tuned semantics and the semantics of the pre-trained language model. The representation obtained by fine-tuning and the representation obtained by prompt tuning are reconstructed into a multidimensional semantics using a gate fusion module (GFM). In particularly, our model has two gate components, one gate to extract the semantics of fine-tuning and the other gate to extract the semantics of prompt tuning, and finally the reconstructed semantic representation is obtained. This takes full advantage of the potential knowledge of PLM. Our model is evaluated on the CONLL2003, ACE2005 and GENIA corpora. It achieves performance close to the state-of-the-art in F1 scores. © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.

关键词： Semantics

来源：评论

学校读者我要写书评

暂无评论

QoS-Based Beamforming and Compression Design for Cooperative Cellular Networks via Lagrangian Duality

引用

IEEE Transactions on Signal Processing 2025年

作者： Fan, Xilai Liu, Ya-Feng Liu, Liang Chang, Tsung-Hui Chinese Academy of Sciences State Key Laboratory of Scientific and Engineering Computing Institute of Computational Mathematics and Scientific/Engineering Computing Academy of Mathematics and Systems Science Beijing100190 China The Hong Kong Polytechnic University Department of Electronic and Information Engineering Hong Kong Hong Kong The Chinese University of HongKong School of Science and Engineering Shenzhen Shenzhen China Shenzhen Research Institute of Big Data China

This paper considers the quality-of-service (QoS)-based joint beamforming and compression design problem in the downlink cooperative cellular network, where multiple relay-like base stations (BSs), connected to the central processor via ratelimited fronthaul links, cooperatively transmit messages to the users. The problem of interest is formulated as the minimization of the total transmit power of the BSs, subject to all users' signal-to-interference-plus-noise ratio (SINR) constraints and all BSs' fronthaul rate constraints. In this paper, we first show that there is no duality gap between the considered joint optimization problem and its Lagrangian dual by showing the tightness of its semidefinite relaxation (SDR). Then, we propose an efficient algorithm based on the above duality result for solving the considered problem. The proposed algorithm judiciously exploits the special structure of an enhanced Karush-Kuhn-Tucker (KKT) conditions of the considered problem and approaches the solution that satisfies the enhanced KKT conditions via two fixed point iterations. Two key features of the proposed algorithm are: (1) it is able to detect whether the considered problem is feasible or not and find its globally optimal solution when it is feasible;(2) it is highly efficient because both of the fixed point iterations in the proposed algorithm are linearly convergent and function evaluations in the fixed point iterations are computationally cheap. Numerical results show the global optimality and efficiency of the proposed algorithm. © 1991-2012 IEEE.

关键词： Lagrange multipliers

来源：评论

学校读者我要写书评

暂无评论

keyword-Oriented Multimodal Modeling for Euphemism Identification

arXiv

引用

arXiv 2025年

作者： Hu, Yuxue Li, Junsong Chen, Meixuan Su, Dongyu Wang, Tongguan Sha, Ying College of Informatics Huazhong Agricultural University Wuhan China Key Laboratory of Smart Farming for Agricultural Animals Wuhan China Hubei Engineering Technology Research Center of Agricultural Big Data Wuhan China Engineering Research Center of Intelligent Technology for Agriculture Ministry of Education China

Euphemism identification deciphers the true meaning of euphemisms, such as linking "weed" (euphemism) to "marijuana" (target keyword) in illicit texts, aiding content moderation and combating underground markets. While existing methods are primarily text-based, the rise of social media highlights the need for multimodal analysis, incorporating text, images, and audio. However, the lack of multimodal datasets for euphemisms limits further research. To address this, we regard euphemisms and their corresponding target keywords as keywords and first introduce a keyword-oriented multimodal corpus of euphemisms (KOM-Euph), involving three datasets (Drug, Weapon, and Sexuality), including text, images, and speech. We further propose a keyword-oriented multimodal euphemism identification method (KOM-EI), which uses cross-modal feature alignment and dynamic fusion modules to explicitly utilize the visual and audio features of the keywords for efficient euphemism identification. Extensive experiments demonstrate that KOM-EI outperforms state-of-the-art models and large language models, and show the importance of our multimodal datasets 1 Copyright © 2025, The Authors. All rights reserved.

关键词：

来源：评论

学校读者我要写书评

暂无评论

Semantic and Emotional Dual Channel for Emotion Recognition in Conversation

引用

IEEE Transactions on Affective computing 2025年

作者： Yang, Zhenyu Zhang, Zhibo Cheng, Yuhu Zhang, Tong Wang, Xuesong Jinan250353 China Shandong Engineering Research Center of Big Data Applied Technology Faculty of Computer Science and Technology Jinan250353 China Shandong Fundamental Research Center for Computer Science Shandong Provincial Key Laboratory of Industrial Network and Information System Security Jinan250353 China China University of Mining and Technology Engineering Research Center of Intelligent Control for Underground Space Ministry of Education Xuzhou Key Laboratory of Artificial Intelligence and Big Data School of Information and Control Engineering Xuzhou221116 China South China University of Technology Guangdong Provincial Key Laboratory of Computational Intelligence and Cyberspace Information School of Computer Science and Engineering Guangzhou510006 China Pazhou Lab Guangzhou510335 China Engineering Research Center Ministry of Education on Health Intelligent Perception and Paralleled Digital-Human Guangzhou China

Emotion recognition in conversation (ERC) aims at accurately identifying emotional states expressed in conversational content. Existing ERC methods, although relying on semantic understanding, often encounter challenges when confronted with incomplete or misleading semantic information. In addition, when dealing with the interaction between emotional and semantic information, existing methods are often difficult to effectively distinguish the complex relationship between the two, which affects the accuracy of emotion recognition. To address the problems of semantic misdirection and emotional cross-talk encountered by traditional models when confronted with complex conversational data, we propose a semantic and emotional dual channel (SEDC) strategy for emotion recognition in conversations to process emotional and semantic information independently. Under this strategy, emotion information provides an auxiliary recognition function when the semantics are unclear or lacking, enhancing the accuracy of the model. Our model consists of two modules: the emotion processing module accurately captures the emotional features of each utterance through contrastive learning, and then constructs a dialogue emotion propagation map to simulate the emotional information conveyed in the dialogue;the semantic processing module combines an external knowledge base to enhance the semantic expression of the dialogue through knowledge enhancement strategies. This divide-and-conquer approach allows us to more deeply analyze the emotional and semantic dimensions of complex dialogues. Experimental results on the IEMOCAP, EmoryNLP, MELD, and DailyDialog datasets show that our approach significantly outperforms existing techniques and effectively improves the accuracy of dialogue emotion recognition. Our code is available at https://***/r/SEDC-FCF1. © 2010-2012 IEEE.

关键词： Contrastive Learning

来源：评论

学校读者我要写书评

暂无评论

Using Depth-Enhanced Spatial Transformation for Student Gaze Target Estimation in Dual-View Classroom Images

Using Depth-Enhanced Spatial Transformation for Student Gaze...

引用

International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

作者： Haonan Miao Peizheng Zhao Yuqi Sun Fang Nan Xiaolong Zhang Yaqiang Wu Feng Tian School of Computer Science and Technology Xi’an Jiaotong University Xi’an China Ministry of Education Key Laboratory of Intelligent Networks and Network Security Xi’an Jiaotong University Xi’an China School of Advanced Technology Xi’an Jiaotong-Liverpool University Suzhou China Shaanxi Province Key Laboratory of Big Data Knowledge Engineering Xi’an Jiaotong University Xi’an China

ISBN: (数字)9798350368741

ISBN: (纸本)9798350368758

Dual-view gaze target estimation in classroom environments has not been thoroughly explored. Existing methods lack consideration of depth information, primarily focusing on 2D image information and neglecting the latent 3D spatial context, which could lead to suboptimal transformation and cause the gaze cone to intersect with an incorrect object. This paper introduces a novel dual-view gaze target estimation method tailored for classroom settings, leveraging depth-enhanced spatial transformations. By formulating a depth-enhanced 2D space, our method uses depth-enhanced spatial transformation to accurately project students’ gaze cones to the teacher-oriented image. Additionally, we collected a dataset named DVSGE, specifically for student gaze target estimation in dual-view classroom images. Experimental results demonstrate significant performance improvements of 9.8% in AUC and 19.9% in L2-Distance for our method, surpassing existing methods.

关键词： Three-dimensional displays Estimation Focusing Signal processing Acoustics Speech processing

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：